-- Logs begin at Mon 2022-08-01 14:25:09 UTC, end at Mon 2022-08-01 15:40:37 UTC. -- Aug 01 15:04:55.702892 dv-cinder-843277-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:04:55.714644 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:04:55 2022] *** Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: nodename: dv-cinder-843277-7-iscsi Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: machine: x86_64 Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: clock source: unix Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: pcre jit disabled Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: detected number of CPU cores: 4 Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: current working directory: / Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:04:55.716616 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: your processes number limit is 47680 Aug 01 15:04:55.717318 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: your memory page size is 4096 bytes Aug 01 15:04:55.717318 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: detected max file descriptor number: 2048 Aug 01 15:04:55.717318 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: lock engine: pthread robust mutexes Aug 01 15:04:55.717318 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: thunder lock: enabled Aug 01 15:04:55.717318 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:04:55.717318 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:04:55.756232 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: Python main interpreter initialized at 0x55fd499299c0 Aug 01 15:04:55.756232 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: python threads support enabled Aug 01 15:04:55.756232 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: your server socket listen backlog is limited to 100 connections Aug 01 15:04:55.756232 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:04:55.756733 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:04:55.756733 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: *** Operational MODE: preforking *** Aug 01 15:04:55.756930 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:04:55.756930 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: spawned uWSGI master process (pid: 103363) Aug 01 15:04:55.757148 dv-cinder-843277-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:04:55.762697 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: spawned uWSGI worker 1 (pid: 103364, cores: 1) Aug 01 15:04:55.762697 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: spawned uWSGI worker 2 (pid: 103365, cores: 1) Aug 01 15:04:55.762697 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:04:56.441390 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:04:56.532332 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:04:57.546557 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:04:57.546557 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: from cryptography.utils import int_from_bytes Aug 01 15:04:57.547236 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:04:57.547236 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: from cryptography.utils import int_from_bytes Aug 01 15:04:58.246148 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:04:58.246148 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: from cryptography.utils import int_from_bytes Aug 01 15:04:58.246960 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:04:58.246960 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: from cryptography.utils import int_from_bytes Aug 01 15:05:00.110408 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:05:00.111152 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:05:00.111289 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:05:00.111545 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:05:00.111799 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:05:00.112182 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.112507 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.112822 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.113139 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.113466 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.113802 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.114261 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.114583 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.114933 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.115190 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.115503 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.115831 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-7-iscsi {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.116144 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.116444 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.116753 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.117177 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.117482 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.117800 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.118102 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.118610 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.119600 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.119907 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.120215 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.120601 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.120850 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.121154 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.121470 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.121771 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.122090 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.122393 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.122814 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-7-iscsi {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.123130 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.123435 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.123745 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.124152 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.124455 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.124759 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.125079 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.125396 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.125697 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.126018 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.126332 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.126642 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.126983 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.127284 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.127585 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.127887 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.128199 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.128645 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.128941 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.129190 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.129494 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.129812 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.130126 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.130444 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.130709 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.130974 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.131275 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.131590 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.131889 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.132192 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.132494 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.132795 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.133096 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.133395 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.133696 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.134013 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.134307 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.134780 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.135614 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.135918 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.136231 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.136622 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.136870 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.137172 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.137507 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.137818 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.138121 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.138438 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.138779 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.139083 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.139386 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.139691 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.140005 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.140334 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.140634 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.140880 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.141175 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.141470 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.141782 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.142082 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.142382 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.142697 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.142998 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.143299 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.143598 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.143897 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.144399 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.144619 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.144919 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.145221 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.145524 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.145824 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.146136 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.146455 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.146788 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.147309 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.147615 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.147921 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.148239 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.148543 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.148845 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.149162 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.149460 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.149761 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.150135 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.150467 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.150796 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.151112 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.151410 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.151710 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.152025 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.152326 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.152628 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.152926 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.153226 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.153525 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.153825 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.154127 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.154422 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.154737 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.155053 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.155377 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.155678 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.155980 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.156282 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.156597 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.156926 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.157253 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.157589 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.157898 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.158224 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.158551 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.158892 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.159199 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.159510 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.159832 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.160140 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.160446 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.160752 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.161066 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.161407 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.161699 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.162010 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.162319 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.162632 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.162968 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.163282 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.163604 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.163919 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.164227 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.164560 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.164897 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.165212 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.165530 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.165847 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.166186 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.166493 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.166826 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.167144 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.167480 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.167790 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.168107 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.168418 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.168726 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.169032 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.169340 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.169649 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.169982 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.170293 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.170605 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.170940 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.171255 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.171568 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.171872 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.172180 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.172482 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.172784 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.173085 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.173391 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.173690 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.174075 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.174522 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.174979 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.175324 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.175650 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.175940 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.176249 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.176556 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.176868 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.177171 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.177478 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.177778 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.178098 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.178405 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.178734 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.179053 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.179355 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.179657 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.179967 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.180275 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.180586 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.180895 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.181249 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.182138 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.182451 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.182788 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.183124 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.183454 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.183760 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.184082 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.184404 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.184716 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.185015 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.185320 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.185627 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.185927 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.186227 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.186533 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.186855 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.187160 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.187457 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.187760 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.188064 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.188384 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.188689 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.188992 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.189291 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.189590 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.189932 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.190234 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.190569 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.191083 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.191398 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.192273 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.192273 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.192625 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.192625 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.192915 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.193223 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.193530 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.193852 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.194156 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.194472 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.194796 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.195115 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.195420 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.195740 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.196038 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.196350 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.196684 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.197010 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.197895 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.198213 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.198521 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.198858 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.199167 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.199473 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.199779 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.200085 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.200399 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.200704 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.201016 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.201320 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.201635 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.201940 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.202251 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.202548 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.202880 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.203206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.203535 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.203839 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.204146 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.204462 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.204766 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.205071 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.205525 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.205832 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.206134 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.206440 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.206773 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.207080 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.207384 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.207684 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.207993 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.208296 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.208849 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.209149 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.209449 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.209766 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.210073 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.210390 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.210727 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.211030 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.211330 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.211650 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.211955 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.212256 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.212558 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.212880 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.213219 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.213525 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.213824 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.214136 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.214452 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.214782 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.215098 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.215401 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.215709 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.216026 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.216336 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.216639 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.216944 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.217250 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.217554 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.217977 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.218286 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.218592 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.218927 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.219235 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.219531 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.219837 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.220149 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.220725 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.221054 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.221365 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.221679 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.221992 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.222304 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.222630 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.222976 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.223311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.223613 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.223919 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.224219 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.224517 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.224821 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.225121 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.225425 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.225723 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.226024 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.226320 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.226619 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.226941 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.227240 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.227551 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.227852 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.228165 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.228485 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.228805 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.229109 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.229413 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.229705 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.230003 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.230340 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.230638 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.230992 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.231316 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.231651 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.231951 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.232249 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.232567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.232867 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.233162 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.233459 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.233761 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.234062 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.234360 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.234708 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.234994 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.235304 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.235604 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.235899 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.236201 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.236570 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.236960 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.237266 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.237563 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.237860 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.238162 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.238464 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.238914 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.239221 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.239524 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.239831 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.240130 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.240427 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.240726 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.241028 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.241331 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.241627 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.241944 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.242251 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.242551 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.242876 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.243179 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.243475 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.243772 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.244606 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.244921 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.245231 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.245560 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.245867 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.246166 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.246465 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.246786 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.247090 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.247386 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.247683 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.247978 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.248275 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.248572 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.248885 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.249185 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.249480 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.249779 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.250073 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.250412 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.250728 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.251081 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.251380 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.251689 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.252002 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.252311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.252618 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.252931 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.253224 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.253532 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.253853 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.254162 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.254460 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.254944 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.255245 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.255554 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.255865 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.256181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.256499 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.256820 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.257118 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.257423 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.257729 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.258033 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.258338 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.258643 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.258969 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.259278 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.259584 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.260432 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.260741 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.261045 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.261351 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.261655 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.261955 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.262277 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.262582 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.262906 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.263214 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.263516 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.263824 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.264124 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.264562 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.264873 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.265180 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.265482 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.265795 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.266103 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.266415 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.266755 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.267060 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.267476 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.267814 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.268242 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.268551 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.268842 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.269143 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.269450 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.269772 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.270075 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.270379 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.270687 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.271020 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.271321 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.271639 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.272052 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.272361 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.272662 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.273073 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.273383 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.273688 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.274007 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.274323 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.274643 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.274973 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.275318 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.275626 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.275949 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.276270 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.276577 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.276887 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.277186 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.277503 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.277819 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.278128 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.278444 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.278883 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.279204 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.279510 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.279829 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.280150 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.280518 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.280744 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.281053 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.281355 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.281658 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.281976 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.282279 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.282586 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.282919 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.283224 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.283525 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.283821 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.284139 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.284437 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.284754 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.285064 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.285382 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.285706 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.286008 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.286322 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.286625 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.287104 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.287403 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.287703 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.288042 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.288342 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.288655 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.288981 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.289302 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.289605 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.289933 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.290253 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.290633 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.290989 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.291314 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.291614 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.291911 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.292217 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.292516 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.292814 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.293113 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.293416 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.293711 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.294007 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.294304 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.294622 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.294947 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.295263 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.295568 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.295870 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.296169 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.296466 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.296803 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.297102 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.297427 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.297741 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.298055 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.298376 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.298713 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.299024 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.299333 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.299639 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.299949 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.300256 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.300563 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.300873 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.301309 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.301616 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.302023 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.302337 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.302650 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.303227 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.303555 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.303864 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.304173 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.304481 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.304791 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.305098 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.305404 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.305719 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.306026 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.306331 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.307263 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.307583 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.307904 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.308234 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.308548 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.308858 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.309172 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.309480 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.309832 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.310143 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.310446 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.310776 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.311090 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.311397 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.311700 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.312005 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.312312 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.312619 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.312925 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.313229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.313539 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.313847 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.314163 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.314492 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.314942 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.315151 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.315461 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.315774 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.316424 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.316734 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.317061 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.317379 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.317696 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.318009 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.318322 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.318642 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.319062 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.319373 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.319678 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.319981 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.320280 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.320596 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.320903 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.321205 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.321520 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.321825 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.322938 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.323285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.323599 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.323921 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.324242 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.324560 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.324863 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.325183 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.325486 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.325788 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.326106 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.326412 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.326739 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.327042 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.327349 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.327651 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.327949 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.328254 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.328558 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.328884 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.329185 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.329487 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.329785 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.330093 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.330393 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.330759 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.331175 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.331457 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.331766 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.332065 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.332369 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.332668 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.332976 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.333275 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.333842 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.334189 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.334510 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.334836 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.335139 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.335451 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.335757 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.336080 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.336389 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.336697 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.337040 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.337353 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.337934 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.338263 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.338579 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.338939 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.339267 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.339570 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.339870 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.340170 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.340489 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.340796 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.341099 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.341406 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.341711 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.342013 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.342316 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.342619 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.342949 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.343252 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.343552 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.343854 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.344166 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.344464 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.344765 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.345072 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.345406 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.345718 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.346035 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.346345 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.346653 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.347112 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.347417 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.347721 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.348023 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.348333 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.348654 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.348960 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.349261 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.349682 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.349988 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.350300 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.350615 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.350945 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.351262 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.351670 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.351981 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.352298 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.352602 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.352926 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.353260 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.354118 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.354446 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.354827 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.355136 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.355430 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.355735 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.356045 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.356350 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.356651 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.356952 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.357247 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.357544 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.357839 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.358135 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.358431 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.358783 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.359052 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.359401 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.359645 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.360003 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.360239 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.360636 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.360837 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.361132 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.361430 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.361872 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.362171 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.362470 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.362823 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.363157 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.363461 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.363780 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.364083 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.364405 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.364703 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.365022 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.365333 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.365645 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.365991 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.366277 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.366591 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.366932 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.367236 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.367621 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.367844 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.368149 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.368469 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.368791 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.369647 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.369998 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.370285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.370596 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.370941 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.371242 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.371569 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.371874 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.372184 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.372486 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.372793 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.373100 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.373407 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.373710 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.374017 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.374368 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.374745 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.374982 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.375300 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.375605 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.375922 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.376240 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.376648 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.376895 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.377236 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.377637 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.377866 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.378175 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.378471 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.378754 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:05:00.533524 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO dbcounter [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Registered counter for database nova_api Aug 01 15:05:00.554436 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103364) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:00.561746 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writer thread running {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:00.591483 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:05:00.592064 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:05:00.592251 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:05:00.592610 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:05:00.592865 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:05:00.593245 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.593567 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.593878 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.594195 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.594517 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.594848 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.595162 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.595478 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.595795 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.596459 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.596565 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.596818 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-7-iscsi {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.597134 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.597437 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.597821 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.598056 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.598415 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.598690 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.598998 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.599503 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.599804 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.600107 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.600407 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.600827 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.601139 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.601443 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.601796 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.602068 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.602390 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.602713 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.603123 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-7-iscsi {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.603990 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.604298 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.604665 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.605138 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.605445 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.605754 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.606069 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.606388 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.606773 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.607040 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.607356 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.607667 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.607982 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.608282 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.608583 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.608886 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.609194 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.609494 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.609795 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.610037 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.610339 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.610716 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.610994 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.611312 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.611558 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.611804 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.612211 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.612530 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.612841 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.613139 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.613447 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.613746 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.614050 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.614350 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.614652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.614978 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.615299 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.615614 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.615926 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.616232 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.616544 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.616942 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.617188 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.617494 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.617830 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.618147 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.618447 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.618794 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.619668 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.619981 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.620204 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.context [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8095a37a-5f92-4ee4-807c-ac452f10613a(cell1) {{(pid=103364) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:05:00.620347 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.620578 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.620896 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.621229 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.621532 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.621799 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.622081 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.622377 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.622710 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.623025 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.623317 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.623618 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.623914 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.624217 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.624324 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:05:00.624518 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.624820 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.625117 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.625420 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.625719 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.625871 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:05:00.626019 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.626322 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.626613 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.626734 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:05:00.626960 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.627277 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.627575 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.627876 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.628180 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.628479 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.628614 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:05:00.628793 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.629099 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.629394 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.629711 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.630009 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.630311 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.630564 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO dbcounter [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Registered counter for database nova_cell0 Aug 01 15:05:00.630725 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.631035 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.631341 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.631656 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.632013 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.632260 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.632649 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.632877 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.633202 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.633478 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.633777 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.634075 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.634379 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.635230 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.635752 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.638992 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.638992 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.638992 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.638992 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.639515 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO dbcounter [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Registered counter for database nova_cell1 Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.639652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.640426 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.640426 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.640426 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.640426 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.641579 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.641579 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.641579 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.641579 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.641915 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.642290 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.642473 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.642914 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.643313 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.644428 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.644428 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.644428 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.644687 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.645016 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.645289 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.645666 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.646091 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.646424 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.646798 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.647202 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.647564 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.647870 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103364) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:00.648001 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.648247 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.648620 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.648770 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103364) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:00.648954 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.649320 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.649687 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.650008 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.651074 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.651389 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.651706 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.652019 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.652362 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.652735 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.652989 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.653304 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.653615 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.653925 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.654232 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.654536 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.655532 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.655532 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.655532 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.655794 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.656061 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.656346 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.656457 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writer thread running {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:00.656667 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.656967 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.657313 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.657596 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.657900 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.658204 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.658503 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writer thread running {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:00.658593 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.658825 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.659133 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.659437 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.659911 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.660232 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.660537 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.660840 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.661158 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.661466 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.661764 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.662082 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.662388 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.662719 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.663032 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.663338 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.663652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.663966 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.664271 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.664603 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.664924 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.665229 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.665541 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.665876 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.666193 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.666494 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.666818 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.667120 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.667419 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.667761 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.668019 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.668369 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.668616 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.668919 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.669212 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.669507 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.669826 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.670125 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.670426 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.670742 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.671044 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.671434 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.671680 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.672019 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.672438 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.672660 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.673017 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.673284 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.673597 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.673897 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.674207 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.674509 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.674962 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.675291 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.675605 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.675925 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.676233 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.676544 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.676853 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.677164 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.677464 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.677777 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.678107 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.678478 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.678777 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.679099 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.679401 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.679709 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.680101 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.680316 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.680624 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.680924 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.681248 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.681560 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.681920 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.682186 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.682501 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.682829 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.683146 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.683442 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.683751 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.684071 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.684396 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.684698 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.685004 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.685317 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.685622 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.685927 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.686230 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.686539 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.686858 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.687164 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.687475 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.687781 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.688083 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.688383 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.688692 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.688997 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.689295 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.689592 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.689896 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.690214 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.690519 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.690942 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.691260 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.691559 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.691856 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.692176 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.692480 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.692779 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.693089 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.693375 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.693708 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.694012 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.694309 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.694618 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.694993 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.695272 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.695583 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.695890 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.696193 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.696508 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.696820 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.697654 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.697966 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.698271 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.698578 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.698905 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.699222 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.699528 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.699833 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.700138 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.700436 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.700740 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.701049 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.701624 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.701956 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.702269 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.702590 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.702946 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.703261 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.703587 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.703912 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.704249 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.704551 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.704856 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.705156 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.705604 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.705757 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.706062 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.706350 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.706775 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.707061 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.707361 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.707661 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.707965 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.709026 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.709026 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.709477 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.709477 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.709963 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.709963 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.710597 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.710597 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.711041 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.711250 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.711596 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.711890 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.712222 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.712556 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.712944 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.713247 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.714054 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.714369 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.714694 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.714989 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.715287 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.715593 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.715893 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.716194 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.716499 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.716802 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.717101 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.717409 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.717702 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.718025 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.718303 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.718607 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.718934 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.719233 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.719527 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.719831 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.720129 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.720430 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.720730 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.721028 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.721333 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.721631 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.721927 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.722223 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.722536 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.722861 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.723162 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.723483 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.723785 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.724085 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.724387 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.724688 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.724988 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.725283 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.725587 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.725903 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.726236 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.726507 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.726836 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.727133 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.727435 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.727732 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.728040 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.728330 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.728654 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.728947 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.729245 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.729611 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.729852 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.730152 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.730452 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.730771 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.731072 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.731414 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.731707 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.732061 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.732359 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.732672 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.732983 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.733289 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.733601 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.733900 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.734201 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.734508 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.734836 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.735143 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.735440 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.735734 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.736049 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.736349 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.736822 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.737107 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.737425 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.737747 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.738053 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.738351 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.738670 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.739054 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.739358 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.739770 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.739964 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.740273 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.740572 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.740880 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.741182 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.741487 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.741791 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.742089 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.742394 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.742731 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.743039 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.743333 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.743636 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.743935 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.744775 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.745073 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.745502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.745812 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.746117 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.746423 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.746801 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.747173 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.747491 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.747856 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.748167 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.748635 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.748993 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.749370 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.749682 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.750044 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.750357 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.750744 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.751126 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.751467 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.751796 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.752153 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.752649 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.752961 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.753328 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.753810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.754122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.754471 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.754912 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.755289 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.755596 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.755967 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.756291 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.756672 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.756976 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.757288 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.757663 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.757987 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.758359 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.758685 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.759068 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.759372 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.760297 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.760623 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.761005 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.761376 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.761792 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.762180 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.762491 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.762886 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.763233 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.763574 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.763926 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.764265 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.764598 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.764904 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.765272 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.765640 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.765966 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.766303 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.766707 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.767001 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.767344 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.767729 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.768167 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.768553 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.769064 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.769389 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.769778 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.770107 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.770549 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.771083 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.771598 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.772098 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.772587 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.773145 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.773642 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.774190 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.774776 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.775350 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.775853 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.776395 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.776911 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.777442 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.777970 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.778506 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.779048 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.779572 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.780101 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.780631 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.781408 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.781694 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.782213 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.782761 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.783294 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.783841 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.784392 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.784916 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.785482 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.786022 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.786601 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.787232 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.787771 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.788288 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.788750 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.789242 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.789715 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.790184 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.790709 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.791380 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.791646 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.792369 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.792607 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.793092 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.793557 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.794020 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.794481 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.795008 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.795482 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.795962 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.796423 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.796880 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.797729 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.798209 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.798705 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.799197 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.799668 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.800138 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.800620 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.801098 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.801569 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.802042 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.802513 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO dbcounter [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Registered counter for database nova_cell0 Aug 01 15:05:00.803172 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.803649 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.804146 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.804683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.805171 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.806094 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.807115 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.807600 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.808144 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.808603 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.809073 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.809539 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.809994 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.810471 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.810680 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103364) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:00.811020 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.811487 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.811965 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.812424 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.812910 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.813381 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.813837 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.814353 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.814898 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.815329 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writer thread running {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:00.815421 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.815887 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.816355 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.816831 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.817326 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.818139 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.818597 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.819160 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.819650 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.820142 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.820621 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.821118 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.821610 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.822074 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.823187 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.823781 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.824244 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.824698 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.825179 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.825653 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.826108 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.826720 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.827294 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.828315 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.828957 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.829502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.829946 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.830368 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.830908 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.831257 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.831687 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.832083 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.832471 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.832812 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.833205 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.833789 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.834176 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.834567 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.835055 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.835400 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.835890 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.836456 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.837063 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.837633 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.838060 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.838494 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.839075 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.839658 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.840240 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.840641 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.841215 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.841807 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.842519 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.843007 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.843566 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.843905 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.844261 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.844592 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.844963 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.845453 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.846033 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.846606 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.847244 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.847824 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.848176 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.848521 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.848840 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.849208 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.849540 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.850133 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.850480 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.850837 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.851386 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.851674 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.851976 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.852409 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.852602 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.852936 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.853249 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.853568 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.853882 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.854196 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.854510 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.854854 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.855167 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.855480 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.855805 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.856105 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.856420 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.856743 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.857037 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.857350 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.857662 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.858008 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.858374 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.858652 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.858999 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.859310 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.859621 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.859927 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.860235 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.860543 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.860910 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.861191 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.861499 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.861805 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.862236 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.862546 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.862896 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.863220 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.863528 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.863851 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.864173 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.864484 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.864804 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.865116 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.865443 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.865783 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.866128 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.866437 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.866841 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.867153 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.867453 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.867762 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.868079 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.868394 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.868697 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.869533 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.869851 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.870155 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.870460 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.870791 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.871092 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.871407 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.871745 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.872013 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.872320 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.872620 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.872922 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.873221 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.873528 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.873897 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.874131 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.874456 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.874757 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.875088 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.875394 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.875725 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.876034 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.876353 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.876666 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.876989 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.877296 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.877685 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.878920 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.878920 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.878920 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.879150 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.879543 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.880017 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.880343 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.880661 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.880976 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.881290 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.881685 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.882045 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.882377 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.882761 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.883250 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.883583 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.884038 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.884264 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.884605 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.885463 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.885797 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.886410 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.886410 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.886948 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.887242 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.887863 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.888050 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.889251 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.889584 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.889913 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.890306 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.890808 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.891553 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.891891 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.892358 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.892686 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.893230 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.893565 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.893883 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.894201 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.894511 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:05:00.894797 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:05:01.046321 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-df435415-635b-4981-a594-e119aff01014 None None] Registered counter for database nova_api Aug 01 15:05:01.067624 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-df435415-635b-4981-a594-e119aff01014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:01.075912 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:01.136172 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.context [None req-df435415-635b-4981-a594-e119aff01014 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8095a37a-5f92-4ee4-807c-ac452f10613a(cell1) {{(pid=103365) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:05:01.140148 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-df435415-635b-4981-a594-e119aff01014 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:05:01.141719 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-df435415-635b-4981-a594-e119aff01014 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:05:01.142509 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-df435415-635b-4981-a594-e119aff01014 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:05:01.144503 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-df435415-635b-4981-a594-e119aff01014 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:05:01.146522 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-df435415-635b-4981-a594-e119aff01014 None None] Registered counter for database nova_cell0 Aug 01 15:05:01.152228 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-df435415-635b-4981-a594-e119aff01014 None None] Registered counter for database nova_cell1 Aug 01 15:05:01.161563 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-df435415-635b-4981-a594-e119aff01014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:01.165140 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-df435415-635b-4981-a594-e119aff01014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:01.168241 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: WARNING keystonemiddleware.auth_token [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:05:01.168718 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:01.177181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: WARNING keystonemiddleware.auth_token [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:05:01.307575 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:01.317355 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-df435415-635b-4981-a594-e119aff01014 None None] Registered counter for database nova_cell0 Aug 01 15:05:01.324149 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-df435415-635b-4981-a594-e119aff01014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:05:01.329015 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:05:01.520663 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: WARNING keystonemiddleware.auth_token [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:05:01.527143 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: WARNING keystonemiddleware.auth_token [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:05:01.532496 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd499299c0 pid: 103364 (default app) Aug 01 15:05:01.534598 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:01.538482 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] 10.222.0.100 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001786 Aug 01 15:05:01.538482 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 793 bytes} [Mon Aug 1 15:05:01 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:01.650795 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-df435415-635b-4981-a594-e119aff01014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:05:01.658202 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-df435415-635b-4981-a594-e119aff01014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:05:02.004298 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-df435415-635b-4981-a594-e119aff01014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:05:02.010316 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-df435415-635b-4981-a594-e119aff01014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:05:02.015642 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fd499299c0 pid: 103365 (default app) Aug 01 15:06:24.392712 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:24.394359 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002295 Aug 01 15:06:24.395176 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 2/2] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:24 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:24.411062 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:24.412698 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell0:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:24.413694 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell1:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:24.414857 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell0:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:25.576205 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-9fed9424-2a5f-4424-9816-65a17222b709 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:25.624153 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-9fed9424-2a5f-4424-9816-65a17222b709 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.218225 Aug 01 15:06:25.630737 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 1/3] 10.222.0.100 () {60 vars in 1296 bytes} [Mon Aug 1 15:06:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:28.007501 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:28.008491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-9ea83b9f-9e00-4550-8f82-677624cfe5b0 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001447 Aug 01 15:06:28.013384 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 3/4] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:28 2022] GET /compute/v2.1 => generated 389 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:28.494044 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-65942d59-5466-4a29-8970-bd05a6288b78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "name": "cirros256", "ram": 256, "vcpus": 1}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:28.517215 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:06:28.517215 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 01 15:06:28.550628 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-65942d59-5466-4a29-8970-bd05a6288b78 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.535211 Aug 01 15:06:28.551532 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 2/5] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:28.566653 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_api:SELECT=3 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:28.569092 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_cell1:SELECT=3 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:28.570424 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_cell0:SELECT=3 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:28.571370 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:28.802761 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-f78fc1d9-7f9c-4a27-9a5a-cbdec3593895 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:28.807036 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:06:28.807036 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: warnings.warn(msg) Aug 01 15:06:28.871447 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-f78fc1d9-7f9c-4a27-9a5a-cbdec3593895 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.310733 Aug 01 15:06:28.871863 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 4/6] 10.222.0.100 () {64 vars in 1340 bytes} [Mon Aug 1 15:06:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:06:31.101784 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-65942d59-5466-4a29-8970-bd05a6288b78 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:31.102896 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-65942d59-5466-4a29-8970-bd05a6288b78 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Aug 01 15:06:31.103290 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 3/7] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:31 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:31.797995 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-68d5dcc2-8546-4226-8996-2d23eff1aa2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:31.817079 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:06:31.817079 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: warnings.warn(msg) Aug 01 15:06:31.840855 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-68d5dcc2-8546-4226-8996-2d23eff1aa2e admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.731275 Aug 01 15:06:31.848275 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 5/8] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:06:31.855611 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-871d31ee-fca9-4864-b978-8f3cfc65cbd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:31.860129 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:06:31.860129 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 01 15:06:31.893776 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-871d31ee-fca9-4864-b978-8f3cfc65cbd9 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042006 Aug 01 15:06:31.894367 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 4/9] 10.222.0.100 () {64 vars in 1340 bytes} [Mon Aug 1 15:06:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:06:34.180659 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-68d5dcc2-8546-4226-8996-2d23eff1aa2e admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:34.181627 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-68d5dcc2-8546-4226-8996-2d23eff1aa2e admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001481 Aug 01 15:06:34.182031 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 6/10] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:34 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:34.593488 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-30b2c774-52e4-43ea-80d8-9fd81d606f67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:34.613960 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-30b2c774-52e4-43ea-80d8-9fd81d606f67 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.425803 Aug 01 15:06:34.614602 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 5/11] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:34.626337 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-d5fd23d4-efa8-4c51-b917-c22e68a0df3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:34.651185 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-d5fd23d4-efa8-4c51-b917-c22e68a0df3a admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028534 Aug 01 15:06:34.651766 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 7/12] 10.222.0.100 () {64 vars in 1340 bytes} [Mon Aug 1 15:06:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:36.877870 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-30b2c774-52e4-43ea-80d8-9fd81d606f67 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:36.878932 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-30b2c774-52e4-43ea-80d8-9fd81d606f67 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Aug 01 15:06:36.879331 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 6/13] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:36 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:37.376878 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-479ca8b9-2637-42f3-abac-7d08eab0ca5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:37.399164 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-479ca8b9-2637-42f3-abac-7d08eab0ca5e admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.513386 Aug 01 15:06:37.400008 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 8/14] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:37.411657 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-905dd744-cf67-4ad5-b0f5-a7086e228771 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:37.436519 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-905dd744-cf67-4ad5-b0f5-a7086e228771 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028405 Aug 01 15:06:37.437109 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 7/15] 10.222.0.100 () {64 vars in 1340 bytes} [Mon Aug 1 15:06:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:39.681925 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-479ca8b9-2637-42f3-abac-7d08eab0ca5e admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:39.682980 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-479ca8b9-2637-42f3-abac-7d08eab0ca5e admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001434 Aug 01 15:06:39.683382 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 9/16] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:39 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:40.167464 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4fd1ff67-937c-4ba1-9125-474a3e7b2094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:40.187636 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-4fd1ff67-937c-4ba1-9125-474a3e7b2094 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.498191 Aug 01 15:06:40.195720 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 8/17] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:40.200787 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-79c801f5-2f34-4c6b-8f7d-f914151602a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:40.228154 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-79c801f5-2f34-4c6b-8f7d-f914151602a0 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031057 Aug 01 15:06:40.228850 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 10/18] 10.222.0.100 () {64 vars in 1340 bytes} [Mon Aug 1 15:06:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:43.122000 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4fd1ff67-937c-4ba1-9125-474a3e7b2094 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:43.123283 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-4fd1ff67-937c-4ba1-9125-474a3e7b2094 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001938 Aug 01 15:06:43.123834 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 9/19] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:43 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:43.615121 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-d0fc9cbb-2670-4d55-9379-f46ede540f4e admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:43.641363 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-d0fc9cbb-2670-4d55-9379-f46ede540f4e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.507082 Aug 01 15:06:43.641912 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 11/20] 10.222.0.100 () {60 vars in 1296 bytes} [Mon Aug 1 15:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:06:45.875440 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4fd1ff67-937c-4ba1-9125-474a3e7b2094 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:45.876450 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-4fd1ff67-937c-4ba1-9125-474a3e7b2094 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001511 Aug 01 15:06:45.876859 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 10/21] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:45 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:46.316429 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-a462d631-893e-43eb-83ae-3d093404dfd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "ram": 512, "vcpus": 1, "disk": 1, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:46.337460 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-a462d631-893e-43eb-83ae-3d093404dfd1 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454080 Aug 01 15:06:46.338030 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 12/22] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:46.351031 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-b8ee0454-16a0-48b7-a8f4-1f54ed1ac9ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:46.378590 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-b8ee0454-16a0-48b7-a8f4-1f54ed1ac9ed admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031771 Aug 01 15:06:46.379209 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 11/23] 10.222.0.100 () {64 vars in 1337 bytes} [Mon Aug 1 15:06:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:48.561716 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-a462d631-893e-43eb-83ae-3d093404dfd1 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:48.562756 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-a462d631-893e-43eb-83ae-3d093404dfd1 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001456 Aug 01 15:06:48.563185 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 13/24] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:48 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:48.982149 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-a35db557-6d5b-400c-b6eb-9e86d0234724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:49.001630 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-a35db557-6d5b-400c-b6eb-9e86d0234724 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.432498 Aug 01 15:06:49.002096 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 12/25] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:49.015261 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-f1b4ca0b-2152-4b93-b62e-58c5b78c7f97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:49.040001 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-f1b4ca0b-2152-4b93-b62e-58c5b78c7f97 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028485 Aug 01 15:06:49.040863 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 14/26] 10.222.0.100 () {64 vars in 1337 bytes} [Mon Aug 1 15:06:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:51.284056 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-a35db557-6d5b-400c-b6eb-9e86d0234724 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:51.285087 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-a35db557-6d5b-400c-b6eb-9e86d0234724 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001470 Aug 01 15:06:51.285642 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 13/27] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:51 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:51.712311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-208a23fc-dbae-4ff0-abb6-f4064530dbb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "disk": 40}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:51.733197 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-208a23fc-dbae-4ff0-abb6-f4064530dbb7 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.440893 Aug 01 15:06:51.733847 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 15/28] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:06:51.746614 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6ee4a67b-01f7-45ff-b8f8-3c35786e1e1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:51.774454 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-6ee4a67b-01f7-45ff-b8f8-3c35786e1e1d admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031779 Aug 01 15:06:51.775216 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 14/29] 10.222.0.100 () {64 vars in 1337 bytes} [Mon Aug 1 15:06:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:06:54.080749 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-208a23fc-dbae-4ff0-abb6-f4064530dbb7 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:54.081751 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-208a23fc-dbae-4ff0-abb6-f4064530dbb7 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001452 Aug 01 15:06:54.082402 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 16/30] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:54 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:54.578354 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-ea9e3e8a-4f40-412d-bb0b-8a4f08adcefb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "disk": 80, "ram": 8192}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:54.584877 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:54.602566 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-ea9e3e8a-4f40-412d-bb0b-8a4f08adcefb admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513536 Aug 01 15:06:54.603147 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 15/31] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:06:54.615531 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-1d4aa111-de1c-41bc-b8f1-65cce6edbda4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:54.640461 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-1d4aa111-de1c-41bc-b8f1-65cce6edbda4 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029056 Aug 01 15:06:54.641335 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 17/32] 10.222.0.100 () {64 vars in 1337 bytes} [Mon Aug 1 15:06:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:56.892947 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-ea9e3e8a-4f40-412d-bb0b-8a4f08adcefb admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:56.893960 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-ea9e3e8a-4f40-412d-bb0b-8a4f08adcefb admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001487 Aug 01 15:06:56.894515 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 16/33] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:06:56 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:57.394171 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-2f6be6e8-c974-4f2a-a899-8e767309c17c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:57.419203 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-2f6be6e8-c974-4f2a-a899-8e767309c17c admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.518350 Aug 01 15:06:57.419755 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 18/34] 10.222.0.100 () {64 vars in 1287 bytes} [Mon Aug 1 15:06:56 2022] POST /compute/v2.1/flavors => generated 410 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:06:57.432136 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-fd696b0a-8220-4adc-80e3-f63770d2fb98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:06:57.458459 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-fd696b0a-8220-4adc-80e3-f63770d2fb98 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029830 Aug 01 15:06:57.459731 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 17/35] 10.222.0.100 () {64 vars in 1337 bytes} [Mon Aug 1 15:06:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:07:16.962606 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-2f6be6e8-c974-4f2a-a899-8e767309c17c admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:16.963677 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-2f6be6e8-c974-4f2a-a899-8e767309c17c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001512 Aug 01 15:07:16.964076 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 19/36] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:07:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:16.975461 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:07:17.376525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-817a6b0b-7722-4965-9e21-b8d500e9e4c5 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:17.395441 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-817a6b0b-7722-4965-9e21-b8d500e9e4c5 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.424403 Aug 01 15:07:17.395904 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 18/37] 10.222.0.100 () {60 vars in 1296 bytes} [Mon Aug 1 15:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:07:18.482497 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-2f6be6e8-c974-4f2a-a899-8e767309c17c admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:18.483557 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-2f6be6e8-c974-4f2a-a899-8e767309c17c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001550 Aug 01 15:07:18.483952 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 20/38] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:18 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:07:19.048615 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-ff668034-b6b2-4c9d-bf98-531115058b8c admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:19.054345 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.wsgi [None req-ff668034-b6b2-4c9d-bf98-531115058b8c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-ff668034-b6b2-4c9d-bf98-531115058b8c admin admin] Request method failure captured: Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Accept: application/json Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Accept-Encoding: gzip, deflate Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Connection: keep-alive Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Content-Length: 0 Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Host: 10.222.0.100 Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Openstack-Api-Version: compute 2.90 Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Openstack-System-Scope: None Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: User-Agent: python-novaclient Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Auth-Token: gAAAAABi5-wmoww0S7H0h7yq0xBTb4hgyxxrr3INRM_05qtBnq0IMeexilNrp7U1NbiJrygcFDBhuZR7ELitvtbbrSFcN7A6NHAvFPFCbGQ9TYlzrkx-WhvxouykLTpJuwp7vPfFJczWX2MlgNCJo-heRGtlJ3Dfq0B5OJfsdh7e2wuAWf3R6wM Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Domain-Id: None Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Domain-Name: None Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Identity-Status: Confirmed Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Is-Admin-Project: True Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Domain-Id: default Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Domain-Name: Default Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Name: admin Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Role: member,reader,admin Aug 01 15:07:19.057683 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Roles: member,reader,admin Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_bcc1ff25500841a3a7180e5fff03ff9f", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant: admin Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant-Name: admin Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User: admin Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Domain-Id: default Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Domain-Name: Default Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Id: 24f06d52227a4059a53df8c2c849eefc Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Name: admin Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: method: > Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: exception: Flavor 42 could not be found. Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: action_args: {'id': '42'} Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:07:19.059429 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:19.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.061721 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-ff668034-b6b2-4c9d-bf98-531115058b8c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:07:19.062852 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-ff668034-b6b2-4c9d-bf98-531115058b8c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.432558 Aug 01 15:07:19.062852 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 19/39] 10.222.0.100 () {60 vars in 1195 bytes} [Mon Aug 1 15:07:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:07:19.068729 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-25ac58c2-e0e6-42d5-9ace-2ac392254754 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:19.072932 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:07:19.093507 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-25ac58c2-e0e6-42d5-9ace-2ac392254754 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028279 Aug 01 15:07:19.094061 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 21/40] 10.222.0.100 () {60 vars in 1215 bytes} [Mon Aug 1 15:07:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:07:19.104577 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-38c4f200-510b-4064-b754-e22919d065bc admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:19.128438 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-38c4f200-510b-4064-b754-e22919d065bc admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027521 Aug 01 15:07:19.128988 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 20/41] 10.222.0.100 () {60 vars in 1215 bytes} [Mon Aug 1 15:07:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:07:19.139896 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-f7a0daa2-8fcf-4c0a-ba17-b9f6e1e90ba8 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:19.146635 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.wsgi [None req-f7a0daa2-8fcf-4c0a-ba17-b9f6e1e90ba8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-f7a0daa2-8fcf-4c0a-ba17-b9f6e1e90ba8 admin admin] Request method failure captured: Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Accept: application/json Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Accept-Encoding: gzip, deflate Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Connection: keep-alive Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Content-Length: 0 Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Host: 10.222.0.100 Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Openstack-Api-Version: compute 2.90 Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Openstack-System-Scope: None Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: User-Agent: python-novaclient Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Auth-Token: gAAAAABi5-wmoww0S7H0h7yq0xBTb4hgyxxrr3INRM_05qtBnq0IMeexilNrp7U1NbiJrygcFDBhuZR7ELitvtbbrSFcN7A6NHAvFPFCbGQ9TYlzrkx-WhvxouykLTpJuwp7vPfFJczWX2MlgNCJo-heRGtlJ3Dfq0B5OJfsdh7e2wuAWf3R6wM Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Domain-Id: None Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Domain-Name: None Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Identity-Status: Confirmed Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Is-Admin-Project: True Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Domain-Id: default Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Domain-Name: Default Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Name: admin Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Role: member,reader,admin Aug 01 15:07:19.149946 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Roles: member,reader,admin Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_bcc1ff25500841a3a7180e5fff03ff9f", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant: admin Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant-Name: admin Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User: admin Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Domain-Id: default Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Domain-Name: Default Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Id: 24f06d52227a4059a53df8c2c849eefc Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Name: admin Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: method: > Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: exception: Flavor 42 could not be found. Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: action_args: {'id': '42'} Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:07:19.151490 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:19.152311 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:19.154567 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-f7a0daa2-8fcf-4c0a-ba17-b9f6e1e90ba8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:07:19.155813 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-f7a0daa2-8fcf-4c0a-ba17-b9f6e1e90ba8 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015808 Aug 01 15:07:19.155813 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 22/42] 10.222.0.100 () {60 vars in 1195 bytes} [Mon Aug 1 15:07:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:07:20.139942 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-38c4f200-510b-4064-b754-e22919d065bc admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:20.140945 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-38c4f200-510b-4064-b754-e22919d065bc admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001442 Aug 01 15:07:20.141342 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 21/43] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:20 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:20.682604 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-0968b79c-5b03-45ca-b14e-71d8dd389786 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:20.688130 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.wsgi [None req-0968b79c-5b03-45ca-b14e-71d8dd389786 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-0968b79c-5b03-45ca-b14e-71d8dd389786 admin admin] Request method failure captured: Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Accept: application/json Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Accept-Encoding: gzip, deflate Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Connection: keep-alive Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Content-Length: 0 Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Host: 10.222.0.100 Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Openstack-Api-Version: compute 2.90 Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Openstack-System-Scope: None Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: User-Agent: python-novaclient Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Auth-Token: gAAAAABi5-woX-Q0XlxhbI2bDzOevE9K_V6wKC20n1yyoDGZtXfTx-wt22YoVW0SbbPUvkouOwGz3zmptgkYjTW1NZSHZniJ5T8Nmile8Ni_jGXAUpmm4wDI9OE5FM8NfzE2LI388C6h9qxeUJNMbQeUSnnrN2ZflhGJfppZtkC3mtAc__HpSmg Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Domain-Id: None Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Domain-Name: None Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Identity-Status: Confirmed Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Is-Admin-Project: True Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Domain-Id: default Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Domain-Name: Default Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Name: admin Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Role: member,reader,admin Aug 01 15:07:20.689652 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Roles: member,reader,admin Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_bcc1ff25500841a3a7180e5fff03ff9f", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant: admin Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant-Name: admin Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User: admin Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Domain-Id: default Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Domain-Name: Default Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Id: 24f06d52227a4059a53df8c2c849eefc Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Name: admin Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: method: > Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: exception: Flavor 84 could not be found. Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: action_args: {'id': '84'} Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:07:20.691211 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:20.692229 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.693285 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-0968b79c-5b03-45ca-b14e-71d8dd389786 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:07:20.694347 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-0968b79c-5b03-45ca-b14e-71d8dd389786 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.411781 Aug 01 15:07:20.694347 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 23/44] 10.222.0.100 () {60 vars in 1195 bytes} [Mon Aug 1 15:07:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:07:20.700923 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-813a0333-9771-41ce-add7-ccd419349fd2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:20.716469 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-813a0333-9771-41ce-add7-ccd419349fd2 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019047 Aug 01 15:07:20.717379 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 22/45] 10.222.0.100 () {60 vars in 1215 bytes} [Mon Aug 1 15:07:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:07:20.727576 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-855ee2ac-698e-47a8-bcb2-a1fc39eaf2dc admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:20.743345 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-855ee2ac-698e-47a8-bcb2-a1fc39eaf2dc admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019942 Aug 01 15:07:20.743899 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 24/46] 10.222.0.100 () {60 vars in 1215 bytes} [Mon Aug 1 15:07:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:07:20.753622 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-b0e1e534-744f-4ea3-9873-1824f2c676d8 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:20.759282 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.wsgi [None req-b0e1e534-744f-4ea3-9873-1824f2c676d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-b0e1e534-744f-4ea3-9873-1824f2c676d8 admin admin] Request method failure captured: Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Accept: application/json Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Accept-Encoding: gzip, deflate Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Connection: keep-alive Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Content-Length: 0 Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Host: 10.222.0.100 Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Openstack-Api-Version: compute 2.90 Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Openstack-System-Scope: None Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: User-Agent: python-novaclient Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Auth-Token: gAAAAABi5-woX-Q0XlxhbI2bDzOevE9K_V6wKC20n1yyoDGZtXfTx-wt22YoVW0SbbPUvkouOwGz3zmptgkYjTW1NZSHZniJ5T8Nmile8Ni_jGXAUpmm4wDI9OE5FM8NfzE2LI388C6h9qxeUJNMbQeUSnnrN2ZflhGJfppZtkC3mtAc__HpSmg Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Domain-Id: None Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Domain-Name: None Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Identity-Status: Confirmed Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Is-Admin-Project: True Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Domain-Id: default Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Domain-Name: Default Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Name: admin Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Role: member,reader,admin Aug 01 15:07:20.760810 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Roles: member,reader,admin Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_bcc1ff25500841a3a7180e5fff03ff9f", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant: admin Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant-Name: admin Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User: admin Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Domain-Id: default Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Domain-Name: Default Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Id: 24f06d52227a4059a53df8c2c849eefc Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Name: admin Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: method: > Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: exception: Flavor 84 could not be found. Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: action_args: {'id': '84'} Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:07:20.762308 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:20.763121 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:20.764183 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-b0e1e534-744f-4ea3-9873-1824f2c676d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:07:20.765191 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-b0e1e534-744f-4ea3-9873-1824f2c676d8 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012203 Aug 01 15:07:20.765191 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 23/47] 10.222.0.100 () {60 vars in 1195 bytes} [Mon Aug 1 15:07:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:07:21.766071 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-855ee2ac-698e-47a8-bcb2-a1fc39eaf2dc admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:21.767156 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-855ee2ac-698e-47a8-bcb2-a1fc39eaf2dc admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001523 Aug 01 15:07:21.767556 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 25/48] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:22.305078 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6c3c3a0f-7b76-42cb-a0f6-2f239e6b88fc admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:22.310981 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.wsgi [None req-6c3c3a0f-7b76-42cb-a0f6-2f239e6b88fc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6c3c3a0f-7b76-42cb-a0f6-2f239e6b88fc admin admin] Request method failure captured: Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Accept: application/json Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Accept-Encoding: gzip, deflate Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Connection: keep-alive Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Content-Length: 0 Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Host: 10.222.0.100 Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Openstack-Api-Version: compute 2.90 Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Openstack-System-Scope: None Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: User-Agent: python-novaclient Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Auth-Token: gAAAAABi5-wpCBljYwyNwk5PUpAE_RQ7JaYWNHsMaOng4-TdOSsfRTotUV0rAxjziOr355jcPaEDzbZ5fJQrhpMa9NB7_NTdJqhvYgN5qTVjHl0r-5JNdIolUhfwqplp_8eYXsYFNEoS3Db4XPGT5EjyqEa1QoVmgZk6IXP8i0Lg0zOpEM-8kdc Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Domain-Id: None Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Domain-Name: None Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Identity-Status: Confirmed Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Is-Admin-Project: True Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Domain-Id: default Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Domain-Name: Default Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Project-Name: admin Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Role: member,reader,admin Aug 01 15:07:22.312525 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Roles: member,reader,admin Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_bcc1ff25500841a3a7180e5fff03ff9f", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant: admin Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-Tenant-Name: admin Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User: admin Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Domain-Id: default Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Domain-Name: Default Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Id: 24f06d52227a4059a53df8c2c849eefc Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: X-User-Name: admin Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: method: > Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: exception: Flavor 451 could not be found. Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: action_args: {'id': '451'} Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:07:22.314203 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:22.315122 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.316314 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6c3c3a0f-7b76-42cb-a0f6-2f239e6b88fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:07:22.317804 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-6c3c3a0f-7b76-42cb-a0f6-2f239e6b88fc admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405887 Aug 01 15:07:22.317804 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 24/49] 10.222.0.100 () {60 vars in 1198 bytes} [Mon Aug 1 15:07:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 15:07:22.323684 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-62dda387-e9ea-48e3-b807-228547258101 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:22.338902 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-62dda387-e9ea-48e3-b807-228547258101 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018697 Aug 01 15:07:22.339452 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 26/50] 10.222.0.100 () {60 vars in 1215 bytes} [Mon Aug 1 15:07:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:07:22.349541 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:22.365460 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019947 Aug 01 15:07:22.366015 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 25/51] 10.222.0.100 () {60 vars in 1215 bytes} [Mon Aug 1 15:07:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:07:22.375613 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-85d65d42-2328-4840-9876-60bf4c3df013 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:22.381035 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.wsgi [None req-85d65d42-2328-4840-9876-60bf4c3df013 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-85d65d42-2328-4840-9876-60bf4c3df013 admin admin] Request method failure captured: Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Accept: application/json Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Accept-Encoding: gzip, deflate Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Connection: keep-alive Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Content-Length: 0 Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Host: 10.222.0.100 Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Openstack-Api-Version: compute 2.90 Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Openstack-System-Scope: None Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: User-Agent: python-novaclient Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Auth-Token: gAAAAABi5-wpCBljYwyNwk5PUpAE_RQ7JaYWNHsMaOng4-TdOSsfRTotUV0rAxjziOr355jcPaEDzbZ5fJQrhpMa9NB7_NTdJqhvYgN5qTVjHl0r-5JNdIolUhfwqplp_8eYXsYFNEoS3Db4XPGT5EjyqEa1QoVmgZk6IXP8i0Lg0zOpEM-8kdc Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Domain-Id: None Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Domain-Name: None Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Identity-Status: Confirmed Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Is-Admin-Project: True Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Domain-Id: default Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Domain-Name: Default Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Project-Name: admin Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Role: member,reader,admin Aug 01 15:07:22.382526 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Roles: member,reader,admin Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_bcc1ff25500841a3a7180e5fff03ff9f", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/bcc1ff25500841a3a7180e5fff03ff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant: admin Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant-Id: bcc1ff25500841a3a7180e5fff03ff9f Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-Tenant-Name: admin Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User: admin Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Domain-Id: default Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Domain-Name: Default Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Id: 24f06d52227a4059a53df8c2c849eefc Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: X-User-Name: admin Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: method: > Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: exception: Flavor 451 could not be found. Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: action_args: {'id': '451'} Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:07:22.384181 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:22.385206 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: ERROR nova.api.openstack.wsgi Aug 01 15:07:22.386491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-85d65d42-2328-4840-9876-60bf4c3df013 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103364) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:07:22.387752 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-85d65d42-2328-4840-9876-60bf4c3df013 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011898 Aug 01 15:07:22.387752 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 27/52] 10.222.0.100 () {60 vars in 1198 bytes} [Mon Aug 1 15:07:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:07:23.372644 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:23.373712 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001480 Aug 01 15:07:23.374143 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 26/53] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:23 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:23.921096 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-276c2d9f-d56a-43a9-b826-f465d5c6eb0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:07:23.940873 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-276c2d9f-d56a-43a9-b826-f465d5c6eb0a admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.426536 Aug 01 15:07:23.941410 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 28/54] 10.222.0.100 () {64 vars in 1240 bytes} [Mon Aug 1 15:07:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:07:24.942320 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:24.944120 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001892 Aug 01 15:07:24.944589 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 27/55] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:24 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:25.482306 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-4dfdb4b3-1fff-4e52-a8a1-3f37d5c3c315 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:07:25.501265 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-4dfdb4b3-1fff-4e52-a8a1-3f37d5c3c315 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.417695 Aug 01 15:07:25.501828 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 29/56] 10.222.0.100 () {64 vars in 1240 bytes} [Mon Aug 1 15:07:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:07:26.493766 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:26.494818 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001429 Aug 01 15:07:26.495215 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 28/57] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:27.070121 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-242e5435-7e76-4ed0-b304-a53a55c93822 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:07:27.091415 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-242e5435-7e76-4ed0-b304-a53a55c93822 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.454437 Aug 01 15:07:27.091996 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 30/58] 10.222.0.100 () {64 vars in 1240 bytes} [Mon Aug 1 15:07:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:07:28.066832 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:28.067916 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001572 Aug 01 15:07:28.068842 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 29/59] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:28 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:28.595799 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-84518042-017f-4787-bfcd-17679b7d1db0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:07:28.614769 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-84518042-017f-4787-bfcd-17679b7d1db0 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.408523 Aug 01 15:07:28.615319 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 31/60] 10.222.0.100 () {64 vars in 1240 bytes} [Mon Aug 1 15:07:28 2022] POST /compute/v2.1/flavors => generated 411 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:07:29.596465 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:29.597476 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001439 Aug 01 15:07:29.597876 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 30/61] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:07:29 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:07:30.132689 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-4a8b4486-4175-490f-a269-56f2cf8d29fc admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:07:30.153667 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-4a8b4486-4175-490f-a269-56f2cf8d29fc admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.417408 Aug 01 15:07:30.154198 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 32/62] 10.222.0.100 () {60 vars in 1207 bytes} [Mon Aug 1 15:07:29 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:08:21.869176 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:08:21.870255 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-8b721742-f053-4292-a870-cf9e88eabfe2 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001868 Aug 01 15:08:21.870726 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 31/63] 10.222.0.100 () {54 vars in 935 bytes} [Mon Aug 1 15:08:21 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:08:21.881872 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:08:22.266854 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-e6c16341-9daa-4cb2-acd9-5e15d9f8e9d7 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:08:22.287958 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-e6c16341-9daa-4cb2-acd9-5e15d9f8e9d7 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.411321 Aug 01 15:08:22.288497 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 33/64] 10.222.0.100 () {60 vars in 1296 bytes} [Mon Aug 1 15:08:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:08:22.311284 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-da3de873-7796-4c3b-a505-be5691eac474 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:08:22.314734 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=14 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:08:22.320441 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-da3de873-7796-4c3b-a505-be5691eac474 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012857 Aug 01 15:08:22.320982 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 32/65] 10.222.0.100 () {60 vars in 1287 bytes} [Mon Aug 1 15:08:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:08:22.332427 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-63077670-cf12-4014-81a7-f451b626441e admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:08:22.340992 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-63077670-cf12-4014-81a7-f451b626441e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012137 Aug 01 15:08:22.341515 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 34/66] 10.222.0.100 () {60 vars in 1290 bytes} [Mon Aug 1 15:08:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:08:22.352854 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:08:22.360894 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011597 Aug 01 15:08:22.361411 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 33/67] 10.222.0.100 () {60 vars in 1290 bytes} [Mon Aug 1 15:08:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:08:22.372503 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-0c8a798e-397d-4e42-b6d3-679f06f83d40 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:08:22.380566 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-0c8a798e-397d-4e42-b6d3-679f06f83d40 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011592 Aug 01 15:08:22.381078 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 35/68] 10.222.0.100 () {60 vars in 1287 bytes} [Mon Aug 1 15:08:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:12:21.143290 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:21.144327 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001498 Aug 01 15:12:21.144717 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 34/69] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:12:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:12:21.287759 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_api:SELECT=6 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:21.445127 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-3fc27ce6-8546-4559-82e9-af5d87885c5e admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:21.447519 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:12:21.447519 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: warnings.warn(msg) Aug 01 15:12:21.448771 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-3fc27ce6-8546-4559-82e9-af5d87885c5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:21.449218 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-3fc27ce6-8546-4559-82e9-af5d87885c5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:21.450009 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-3fc27ce6-8546-4559-82e9-af5d87885c5e admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:21.450441 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-3fc27ce6-8546-4559-82e9-af5d87885c5e admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:21.486156 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-3fc27ce6-8546-4559-82e9-af5d87885c5e admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200037 Aug 01 15:12:21.486752 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 36/70] 10.222.0.100 () {60 vars in 1198 bytes} [Mon Aug 1 15:12:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:12:22.331666 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:22.333269 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001984 Aug 01 15:12:22.333914 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 35/71] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:12:22 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:12:22.529608 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-44683ec0-398c-4038-95ac-9584925e6aff admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:22.532128 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:12:22.532128 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: warnings.warn(msg) Aug 01 15:12:22.533270 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-44683ec0-398c-4038-95ac-9584925e6aff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:22.533710 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-44683ec0-398c-4038-95ac-9584925e6aff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:22.534498 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-44683ec0-398c-4038-95ac-9584925e6aff admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:22.534952 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-44683ec0-398c-4038-95ac-9584925e6aff admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:22.554265 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-44683ec0-398c-4038-95ac-9584925e6aff admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078646 Aug 01 15:12:22.554889 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 37/72] 10.222.0.100 () {60 vars in 1198 bytes} [Mon Aug 1 15:12:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:12:33.846324 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:33.847356 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 Aug 01 15:12:33.848292 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 36/73] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:12:33 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:12:33.996428 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_cell0:SELECT=4 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:33.997155 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_cell1:SELECT=4 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:33.997761 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG dbcounter [-] [103364] Writing DB stats nova_api:SELECT=8 {{(pid=103364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:34.060447 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-bddd3038-6360-4f94-ae05-4e0199dcb147 admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:34.062916 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:12:34.062916 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: warnings.warn(msg) Aug 01 15:12:34.064179 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-bddd3038-6360-4f94-ae05-4e0199dcb147 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:34.064622 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-bddd3038-6360-4f94-ae05-4e0199dcb147 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:34.065469 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-bddd3038-6360-4f94-ae05-4e0199dcb147 admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:34.065889 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-bddd3038-6360-4f94-ae05-4e0199dcb147 admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:34.092143 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-bddd3038-6360-4f94-ae05-4e0199dcb147 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.100218 Aug 01 15:12:34.092719 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 38/74] 10.222.0.100 () {60 vars in 1198 bytes} [Mon Aug 1 15:12:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:12:34.975977 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:34.977320 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c38e9b54-e7fd-4d19-94db-02653e21d855 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001842 Aug 01 15:12:34.977987 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 37/75] 10.222.0.100 () {56 vars in 1079 bytes} [Mon Aug 1 15:12:34 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:12:35.195491 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG nova.api.openstack.wsgi [None req-532e8274-d6b1-445e-8283-a19b88ee4fce admin admin] Calling method '>' {{(pid=103364) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:35.198118 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:12:35.198118 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: warnings.warn(msg) Aug 01 15:12:35.199376 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-532e8274-d6b1-445e-8283-a19b88ee4fce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:35.199943 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-532e8274-d6b1-445e-8283-a19b88ee4fce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:35.200756 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-532e8274-d6b1-445e-8283-a19b88ee4fce admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:12:35.201230 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: DEBUG oslo_concurrency.lockutils [None req-532e8274-d6b1-445e-8283-a19b88ee4fce admin admin] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103364) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:12:35.224711 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: INFO nova.api.openstack.requestlog [None req-532e8274-d6b1-445e-8283-a19b88ee4fce admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087419 Aug 01 15:12:35.225288 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: [pid: 103364|app: 0|req: 39/76] 10.222.0.100 () {60 vars in 1198 bytes} [Mon Aug 1 15:12:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:35.502501 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: Mon Aug 1 15:13:35 2022 - graceful shutdown triggered... Aug 01 15:13:35.503027 dv-cinder-843277-7-iscsi devstack@n-api.service[103364]: Gracefully killing worker 1 (pid: 103364)... Aug 01 15:13:35.502599 dv-cinder-843277-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 15:13:35.503841 dv-cinder-843277-7-iscsi devstack@n-api.service[103365]: Gracefully killing worker 2 (pid: 103365)... Aug 01 15:13:36.503657 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: worker 1 buried after 1 seconds Aug 01 15:13:36.503657 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: worker 2 buried after 1 seconds Aug 01 15:13:36.504338 dv-cinder-843277-7-iscsi devstack@n-api.service[103363]: goodbye to uWSGI. Aug 01 15:13:36.505263 dv-cinder-843277-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 15:13:36.505820 dv-cinder-843277-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 15:13:36.508700 dv-cinder-843277-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:13:36.518580 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:13:36 2022] *** Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: nodename: dv-cinder-843277-7-iscsi Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: machine: x86_64 Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: clock source: unix Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: pcre jit disabled Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: detected number of CPU cores: 4 Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: current working directory: / Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: your processes number limit is 47680 Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: your memory page size is 4096 bytes Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: detected max file descriptor number: 2048 Aug 01 15:13:36.520533 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: lock engine: pthread robust mutexes Aug 01 15:13:36.521473 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: thunder lock: enabled Aug 01 15:13:36.521473 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:13:36.521473 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:13:36.561941 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: Python main interpreter initialized at 0x55888ed5a9c0 Aug 01 15:13:36.561941 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: python threads support enabled Aug 01 15:13:36.561941 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: your server socket listen backlog is limited to 100 connections Aug 01 15:13:36.561941 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:13:36.562356 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:13:36.562446 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: *** Operational MODE: preforking *** Aug 01 15:13:36.562702 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:13:36.562702 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: spawned uWSGI master process (pid: 117868) Aug 01 15:13:36.562912 dv-cinder-843277-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:13:36.563517 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: spawned uWSGI worker 1 (pid: 117886, cores: 1) Aug 01 15:13:36.564024 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: spawned uWSGI worker 2 (pid: 117887, cores: 1) Aug 01 15:13:36.564316 dv-cinder-843277-7-iscsi devstack@n-api.service[117868]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:13:37.240146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:13:37.246633 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:13:38.406897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:13:38.406897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: from cryptography.utils import int_from_bytes Aug 01 15:13:38.407607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:13:38.407607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: from cryptography.utils import int_from_bytes Aug 01 15:13:38.422690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:13:38.422690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: from cryptography.utils import int_from_bytes Aug 01 15:13:38.423204 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:13:38.423204 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: from cryptography.utils import int_from_bytes Aug 01 15:13:40.871307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:13:40.871899 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:13:40.872144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:13:40.873016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:13:40.873283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:13:40.873736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.874067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.874396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.874743 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.875085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.875402 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.875731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.876051 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.876386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.876652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.876971 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.877310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-7-iscsi {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.877636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.878135 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.878453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.878812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.879128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.879458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.879789 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.880298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.881065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.881383 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.881798 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.882160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.882482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.882823 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.883154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.884079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.884079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.884079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.884491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-7-iscsi {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.884874 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.885245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.885566 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.886004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.886323 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.886638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.886993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.887330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.887644 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.887982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.888903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.889260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.889593 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.889902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.890218 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.890531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.890918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.891232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.891541 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.891893 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.892212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.892544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.892871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.893201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.893459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.893713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.894042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.894368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.894694 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.895008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.895319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.895630 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.895943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.896249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.896558 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.896865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.897205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.897528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.897859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.898168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.898492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.898965 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.899223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.899532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.899884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.900207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.900527 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.900846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.901172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.901481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.901793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.902100 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.902633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.903148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.903465 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.903756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.904066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.904376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.904700 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.905011 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.905320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.905632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.905935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.906243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.906553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.906910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.907224 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.907532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.907839 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.908145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.908454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.908762 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.909092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.909417 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.909725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.910030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.910334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.910642 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.910988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.911295 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.911603 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.911933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.912241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.912548 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.912868 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.913175 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.913481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.913802 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.914105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.914410 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.914764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.915075 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.915381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.915683 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.915987 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.916292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.916596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.916906 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.917215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.917514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.917833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.918157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.918469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.918808 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.919113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.919483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.919826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.920160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.920506 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.920824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.921163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.921498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.921819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.922133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.922446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.922857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.923235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.923551 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.923866 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.924188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.924508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.924841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.925159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.925479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.926034 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.926415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.926755 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.927142 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.927485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.927939 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.928292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.928826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.929155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.929487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.929828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.930138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.930452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.930862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.931083 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:13:40.931523 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.931609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:13:40.931691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.931809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.931942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:13:40.932246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:13:40.932466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.932567 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:13:40.932786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.932898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.933116 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.933232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.933429 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.933552 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.933826 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.933929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.934165 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.934261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.934534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.934731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.935405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.935567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.935736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.935879 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.936020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.936159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.936308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.936468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.936637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.936795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.936949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-7-iscsi {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.937080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.937221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.937438 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.937643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.937750 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.937973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.938109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.938302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.938616 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.938958 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.939104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.939221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.939452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.939624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.939925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.940089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.940264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.940414 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.940579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.940725 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.940922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.941067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.941234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.941352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.941549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.941656 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.941862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.941956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.942177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.942283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.942486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.942589 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.942830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.942942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.943143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.943246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.943452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.943619 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-7-iscsi {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.943782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.943946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.944095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.944267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.944403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.944589 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.944732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.945018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.945112 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.945338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.945438 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.945652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.945743 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.945963 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.946104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.946279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.946373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.946590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.946750 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.946932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.947074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.947260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.947362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.947579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.947684 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.947895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.948005 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.948200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.948292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.948515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.948608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.948828 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.948996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.949157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.949270 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.949469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.949570 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.949781 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.949883 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.950037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.950219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.950350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.950445 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.951271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.951390 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.951583 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.951686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.951893 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.951993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.952167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.952261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.952423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.952536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.952752 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.952854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.953069 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.953174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.953374 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.953476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.953680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.953787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.953986 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.954091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.954302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.954409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.954602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.954730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.954937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.955030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.955239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.955345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.955554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.955647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.955878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.955970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.956195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.956300 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.956528 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.956626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.956842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.956936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.957166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.957310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.957486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.957621 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.957804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.957907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.958371 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.958626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.958800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.959002 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.959106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.959310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.959403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.959631 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.959724 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.959942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.960036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.960263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.960411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.960572 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.960672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.960886 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.961024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.961199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.961296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.961526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.961622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.961871 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.962181 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.962442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.962636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.962817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.962994 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.963160 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.963345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.963499 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.963678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.963836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.963996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.964150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.964308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.964452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.964603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.964756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.964910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.965055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.965207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.965357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.965510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.965654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.965806 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.966791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.966909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.967203 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.967290 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.967365 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.967454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.967555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.967655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.967732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.967812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.967892 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.967975 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.968050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.968286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.968365 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.968447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.968530 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.968604 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.968676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.968950 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.969060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.969281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.969406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.969608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.969718 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.970174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.970389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.970503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.970581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.970654 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.970772 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.970863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.970945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.971177 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.971365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.971524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.971678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.971837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.971991 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.972141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.972292 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.972447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.972606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.972756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.972906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.973055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.973201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.973352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.973511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.973653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.973802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.973949 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.974099 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.974256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.974407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.974549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.974724 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.974826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.974914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.975043 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.975147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.975370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.975472 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.975682 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.975776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.975983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.976079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.976310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.976452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.976615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.976708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.976921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.977016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.977236 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.977328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.977546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.977640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.977848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.977948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:13:40.978157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.978258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.978462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.978562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.978836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.978951 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.979151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.979249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.979457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.979570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.979775 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.979880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.980097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.980199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.980409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.980510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.980732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.980826 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.981055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.981152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.981341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.981447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.981668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.981783 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982451 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982781 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.982995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.983098 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.983309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.983402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.983623 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.983716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.983944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984252 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984876 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.984977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.985182 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.985284 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.985522 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.985634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.985812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.985913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.986213 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.986399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.986535 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.986793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.986894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.987079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.987183 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.987402 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.987503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.987730 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.987826 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.988053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.988148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.988386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.988478 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.988712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.988810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989030 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.989973 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.990073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.990282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.990389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.990592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.990699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.990949 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991644 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.991962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.992169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.992271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.992476 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.992570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.992782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.992882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.993088 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.993190 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.993402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.993494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.993703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.993803 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994784 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.994959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.995055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.995294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.995498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.996287 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.996476 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.996640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.996797 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.996946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.997106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.997253 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.997938 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.998093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.998093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.998377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.998529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.998702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.998867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:40.999941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000376 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.000982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.001167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.001419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.001666 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.001970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.002177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.002327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.002472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.002623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.002623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.002942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003807 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.003913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.004089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.004175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.004473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.004661 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.004805 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.005176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.005294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.005472 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.005757 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.005897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.006200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.006373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.006519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.006857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.006969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.007169 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.007420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.007521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.007774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.008079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.008175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.008385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.008689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.008816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.008992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.009256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.009361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.009618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.009928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.010240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.010352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.010547 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.010921 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.011016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.011235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.011462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.011572 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.011918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.012041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.012241 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.012574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.012677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.012892 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.013785 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.013934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.014082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.014401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.014735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.015842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.015842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016313 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016832 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.016927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.017207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.017403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.017537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.017827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.017988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.018174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.018518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.018655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.018865 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.019196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.019295 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.019514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.019738 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.019848 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.020132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.020289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.020448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.020764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.020872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.021078 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.021305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.021398 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.021703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.021862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.022039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.022327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.022478 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.022676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.022942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.023094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.023304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.023480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.023620 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.024070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.024248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.024391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.024544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.024689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.024871 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.025053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.025205 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.025498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.025648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.025820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.026014 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.026159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.026438 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.026585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.026793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.027070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.027225 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.027372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.027676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.027845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.028143 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.028292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.028464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.028764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.028919 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.029110 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.029294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.029432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.029720 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.029865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.030017 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.030324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.030470 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.030651 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.030876 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.030972 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.031306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.031470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.031638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.031949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.032049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.032259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.032582 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.032749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.032897 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.033097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.033224 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.033479 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.033620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.033786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.034140 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.034314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.034458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.034695 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.034793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.035080 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.035217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.035409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.035725 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.035827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.036057 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.036244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.036373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.036689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.036780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.037019 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.037281 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.037375 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.037643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.037827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.037963 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.038281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.038377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.038598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.038887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.038999 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.039257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.039432 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.039574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.039891 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.039991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.040207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.040480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.040576 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.040820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.041029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.041226 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.041581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.041835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.042180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.042294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.042505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.042855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.043183 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.043515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.043831 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.043944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.044184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.044560 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.044668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.044876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.045113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.045232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.045488 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.045646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.046105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.046221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.046458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.046766 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.047897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.047989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.047989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048215 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048215 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048439 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048776 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.048935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.049132 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.049251 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.049502 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.049670 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.049819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.050131 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.050243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.050465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.050756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.050873 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.051103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.051310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.051424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.051710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.052011 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.052105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.052363 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.052579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.052712 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.053051 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.053144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.053405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.053659 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.053762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.054014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.054200 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.054349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.054721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.054826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.054993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.055272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.055392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.055784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.055901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.055993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.056208 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.056518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.056615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.056822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.057044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.057142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.057466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.057597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.057737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.058052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.058160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.058362 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.058629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.058762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.059010 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.059207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.059310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.059615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.059754 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.060461 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.060779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.060874 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.061090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.061332 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.061435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.061702 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.062023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.062118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.062335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.062570 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.062720 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.062980 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.063129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.063295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.063609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.063712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.063920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.064190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.064283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.064557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.064767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.064885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.065167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.065287 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.065483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.065781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.066062 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.066216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.066365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.066536 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.066867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.066989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.067206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.067390 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.067514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.067832 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.067934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.068144 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.068454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.068550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.068763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.069020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.069116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.069370 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.069680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.069781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.069992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.070240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.070335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.070600 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.070804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.070956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.071271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.071516 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.071612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.071881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.072045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.072191 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.072545 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.072646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.072856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.073120 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.073223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.073519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.073682 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.073839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.074293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.074430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.074612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.074957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.075136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.075299 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.075624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.077109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.077109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.077109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.077557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.077653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.077752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.078288 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.078887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.079096 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.079449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.079592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.079798 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.080005 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.080136 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.080477 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.080677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.080815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.081167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.081289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.081492 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.081789 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.081911 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.082130 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.082341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.082465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.082909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.083310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.083625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.083914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.084090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.084481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.084625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.085000 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.085164 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.085367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.085541 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.086013 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.086151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.086612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.086791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.087205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.087412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.087684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.088009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.088200 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.088449 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.088760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.088908 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.089285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.089427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.089726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.089886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.090168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.090369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.090632 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.091041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.091221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.091522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.091665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.092097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.092244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.092543 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.092697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.092989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.093161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.093464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.093697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.093917 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.094249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.094386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.094819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.094972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.095270 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.095419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.095741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.095923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.096401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.096554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.096960 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.097363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.097510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.097632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.097960 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.098104 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.098395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.098541 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.099349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.099504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.099653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.099794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.099939 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.100113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.100258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.100562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.100708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.101001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.101189 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.101461 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.101746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.101935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.102286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.102434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.102879 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.103022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.103343 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.103486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.103782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.103953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.104338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.104483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.104779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.105029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.105261 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.105558 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.105705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.106076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.106217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.106611 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.106838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.107103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.107567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.107700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.107834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.108088 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.108236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.108546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.108728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.109004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.109249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.109446 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.109763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.109910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.110263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.110400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.110744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.111001 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.111716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.111858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.111993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.112133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.112274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.112422 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.112652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.112902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.113041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.113389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.113532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.113838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.113982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.114294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.114486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.114752 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.115043 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.115200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.115551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.115709 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.116005 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.116151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.116523 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.116661 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.116977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.117194 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.117503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.117837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.117978 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.118256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.118396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.118796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.118937 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.119244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.119406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.119679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.119935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.120129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.120468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.120613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.120945 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.121089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.121436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.121590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.121956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.122109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.122962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.123120 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.123425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.123646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.123882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.124185 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.124322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.124677 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.124820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.125112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.125536 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.125690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.125970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.126198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.126514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.126746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.126989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.127282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.127437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.127935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.128086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.128403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.128559 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.128904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.129139 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.129388 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.129669 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.129819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.130205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.130473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.130652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.130819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.131108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.131297 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.131541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.131855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.132164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.132344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.132481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.132776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.132950 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.133207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.133520 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.133667 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.133999 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.134143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.134432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.134575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.134884 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.135160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.135343 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.135701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.135855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.136234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.136386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.136701 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.136847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.137139 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.137515 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.137689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.137990 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.138370 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.138519 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.138705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.138998 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.139147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.139520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.139657 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.139971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.140115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.140424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.140645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.140886 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.141083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.141336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.141624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.141791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.142157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.142294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.142602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.142772 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.143075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.143264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.143519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.143825 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.143971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.144336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.144473 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.144776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.144921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.145211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.145447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.145653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.146001 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.146149 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.146498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.146701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.147204 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.147458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.147668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.148007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.148163 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.148574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.148726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.149046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.149192 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.149487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.149668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.150395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.150536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.150797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.150797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.151057 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.151199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.151347 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.151571 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.151845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.152026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.152367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.152593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.152852 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.152997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.153316 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.153454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.154308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.154462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.154844 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.155006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.155290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.155522 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.155735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.156046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.156218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.156609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.156757 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.157029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.157252 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.157613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.158120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.158268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.158685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.158833 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.159081 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.159220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.159519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.159767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.159964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.160321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.160474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.160831 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.160985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.161260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.161406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.161704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.161914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.162148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.162452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.162596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.163023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.163177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.163489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.163635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.163936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.164071 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.164444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.164605 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.164923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.165129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.165632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.165820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.166160 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.166310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.166816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.166968 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.167136 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.167288 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.167674 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.167860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.168310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.168467 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.168931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.169070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.169331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.169996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.170274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.170428 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.170793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.171156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.171326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.171485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.171643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.171843 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.171997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.172174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.172431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.172595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.172797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.172958 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.173163 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.173497 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.173663 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.174022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.174240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.174547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.174764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.174934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.175090 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.175277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.175610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.175764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.175935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.176573 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.177029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.177194 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.177360 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.177966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.178147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.178318 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.178740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.181578 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.181774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.181936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.182114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.182271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.182271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.182570 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.182813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.182813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.183121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.183278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.183427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.183573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.183573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.183861 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184637 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.184794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.185245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.185395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.185395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.185703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.185861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.185861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.186156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.186333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.186333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.186810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.187153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.187153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.187450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.187600 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.187787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.188085 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.188085 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.188391 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.188668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.188668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.189077 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.189227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.189227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.190138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.190297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.190446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.190613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.190819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.190970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.191157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.191310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.191310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.192837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.193133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.193281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.193435 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.193584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.193584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.193887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194488 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194644 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194843 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.194843 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.195134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.195288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.195288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.195597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.195746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.195746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.196036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.196192 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.196349 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.196516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.196516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.196868 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.197035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.197035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.197467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.197618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.197618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.197905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.198091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.198316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.198482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.198482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.198944 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.199198 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.199351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.199578 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.199578 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.199862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.200011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.200165 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.200320 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.200525 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.200682 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.200829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.201082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.201237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.201407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.201675 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.201861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.202296 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.202460 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.202611 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.202811 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.202980 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.203162 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.203479 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.203639 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.203797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.204108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.204421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.204749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.205076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.205390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.205714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.205878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.206029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.206351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.206732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.207061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.207396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.207706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.208366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.208656 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.208969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.209134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.209396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.209556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.209713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.210000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.210165 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.210314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.210606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.210980 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.211299 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.211610 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.211922 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.212105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.212548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.212548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.212866 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.213023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.213182 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.213350 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.213608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.213771 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.213928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.214076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.214222 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.214379 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.214580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.214809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.214979 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.215226 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.215398 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.215560 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.215833 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.215987 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.216710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.217035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.217190 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.217352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.217597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.218006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.218166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.218316 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.218638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.218846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.219012 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.219244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.219428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.219727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.219896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.220047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.220665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.220970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.221191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.221356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.221743 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.222057 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.222258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.222842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223416 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.223983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.224356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.224542 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.224542 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.224907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.225101 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.225288 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.225483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.225483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.225848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.226033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.226033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.226389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.226585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.226787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.226973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.227159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.227366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.227665 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.227665 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.228054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.228249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.228436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.228758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.228758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.229229 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.229523 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.229824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.230035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.230035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.230420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.230614 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.230614 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.231007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.231191 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.231370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.231544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.231544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.231910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.232730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.233071 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.233241 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.233241 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.233580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.233729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.233729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.234016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.234180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.234180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.234469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.234618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:13:41.234821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.235025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.235588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.236150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.236704 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.237267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.237805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.238870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.239056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.239543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.239984 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.240509 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.241040 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.241576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.242133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.242742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.243247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.243808 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.244351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.244895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.245431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.245976 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.246537 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.247122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.247694 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.248236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.248767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.249299 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.249846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.250377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.250960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.251531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.252062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.252632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.253342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.253706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.254266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.254878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.255477 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.256007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.256602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.257159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.257737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.258284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.258865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:13:41.259291 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:13:41.305637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Registered counter for database nova_api Aug 01 15:13:41.326889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.333860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.375610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO dbcounter [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Registered counter for database nova_api Aug 01 15:13:41.390618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.context [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8095a37a-5f92-4ee4-807c-ac452f10613a(cell1) {{(pid=117886) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:13:41.395390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.397246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.398054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.400094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.402091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Registered counter for database nova_cell0 Aug 01 15:13:41.406952 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Registered counter for database nova_cell1 Aug 01 15:13:41.408247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_db.sqlalchemy.engines [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.414924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.415229 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writer thread running {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.416879 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.422976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.425086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.473180 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.context [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8095a37a-5f92-4ee4-807c-ac452f10613a(cell1) {{(pid=117887) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:13:41.477702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.479349 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.480144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.482179 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.484188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO dbcounter [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Registered counter for database nova_cell0 Aug 01 15:13:41.488301 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO dbcounter [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Registered counter for database nova_cell1 Aug 01 15:13:41.495740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_db.sqlalchemy.engines [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.497101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_db.sqlalchemy.engines [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.503483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writer thread running {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.506017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writer thread running {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.572779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Registered counter for database nova_cell0 Aug 01 15:13:41.580820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.585598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.655446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO dbcounter [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Registered counter for database nova_cell0 Aug 01 15:13:41.664353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_db.sqlalchemy.engines [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:13:41.668845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writer thread running {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:13:41.908917 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:13:41.916206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:13:41.992367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: WARNING keystonemiddleware.auth_token [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:13:42.000464 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: WARNING keystonemiddleware.auth_token [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:13:42.259685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:13:42.266595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-e49b959d-3b6b-463b-bd32-f16a03b10d5d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:13:42.272113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55888ed5a9c0 pid: 117886 (default app) Aug 01 15:13:42.349925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: WARNING keystonemiddleware.auth_token [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:13:42.356169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: WARNING keystonemiddleware.auth_token [None req-3b014343-c820-4c5d-b5ac-2b85b239dd27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:13:42.362100 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55888ed5a9c0 pid: 117887 (default app) Aug 01 15:14:25.133628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.134524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.135304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.136129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.158110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.159728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.161022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:25.163287 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:26.338887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0659c551-bf0a-4b9c-8b78-c330a4c29233 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Action: 'create', calling method: .version_select at 0x7efd1f11eee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-382565397", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:26.656723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6bc529ad-1a09-4194-9ab3-8e5dbd91586c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Action: 'create', calling method: .version_select at 0x7efd1f11cee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1341784885", "metadata": {"Type": "work"}}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6bc529ad-1a09-4194-9ab3-8e5dbd91586c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Request method failure captured: Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 122 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RSGbPUQa1wROtJ1XTR6hzjOQN42FA-NMroL8RrEoGczCuGhrMZZe5kTZG-Cjco7zD-3Ym1pwxT0v_WraCE0ees873iB8vTTmau2ApAVPExe9900xaM1vpj-Yq3Q7XiK9ul7tH1yNFgHUuL5aSjykKNjP-yV0FniOJMp0CEhPAY48 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:26.677381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b7d2693930994c6c990461c488626517", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b7d2693930994c6c990461c488626517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 47f5aec582c742b18cb17bddd77f2891 Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1341784885", "metadata": {"Type": "work"}}} Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:26.679134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1341784885', 'metadata': {'Type': 'work'}}}} Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:26.680085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:14:26.681717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:14:26.683195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:14:26.683195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.683561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6bc529ad-1a09-4194-9ab3-8e5dbd91586c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:26.685080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6bc529ad-1a09-4194-9ab3-8e5dbd91586c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.540459 Aug 01 15:14:26.686087 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 1/1] 10.222.0.100 () {60 vars in 1161 bytes} [Mon Aug 1 15:14:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1543 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:14:26.704837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dfd205a0-4bed-460b-aa5e-235becddaafa tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Action: 'create', calling method: .version_select at 0x7efd1f0319d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1691324825", "metadata": {"Type": "work"}}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dfd205a0-4bed-460b-aa5e-235becddaafa tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Request method failure captured: Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 120 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RSGbPUQa1wROtJ1XTR6hzjOQN42FA-NMroL8RrEoGczCuGhrMZZe5kTZG-Cjco7zD-3Ym1pwxT0v_WraCE0ees873iB8vTTmau2ApAVPExe9900xaM1vpj-Yq3Q7XiK9ul7tH1yNFgHUuL5aSjykKNjP-yV0FniOJMp0CEhPAY48 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:26.709169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b7d2693930994c6c990461c488626517", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b7d2693930994c6c990461c488626517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 47f5aec582c742b18cb17bddd77f2891 Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1691324825", "metadata": {"Type": "work"}}} Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:26.710746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1691324825', 'metadata': {'Type': 'work'}}}} Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi '0' Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:26.711824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:14:26.713382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:14:26.715315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:14:26.715315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.715315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dfd205a0-4bed-460b-aa5e-235becddaafa tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:26.715315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dfd205a0-4bed-460b-aa5e-235becddaafa tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015566 Aug 01 15:14:26.715315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 2/2] 10.222.0.100 () {60 vars in 1161 bytes} [Mon Aug 1 15:14:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:14:26.723584 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a3f1690c-b81e-4a58-ba47-d76b27da8817 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Action: 'create', calling method: .version_select at 0x7efd1efeea60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1010779581", "metadata": {"Type": "work"}}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a3f1690c-b81e-4a58-ba47-d76b27da8817 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Request method failure captured: Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 119 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RSGbPUQa1wROtJ1XTR6hzjOQN42FA-NMroL8RrEoGczCuGhrMZZe5kTZG-Cjco7zD-3Ym1pwxT0v_WraCE0ees873iB8vTTmau2ApAVPExe9900xaM1vpj-Yq3Q7XiK9ul7tH1yNFgHUuL5aSjykKNjP-yV0FniOJMp0CEhPAY48 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:26.731942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b7d2693930994c6c990461c488626517", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b7d2693930994c6c990461c488626517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 47f5aec582c742b18cb17bddd77f2891 Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1010779581", "metadata": {"Type": "work"}}} Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:26.733283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1010779581', 'metadata': {'Type': 'work'}}}} Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi '' Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:26.734145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:14:26.735471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:14:26.736553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:14:26.736553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:26.736553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a3f1690c-b81e-4a58-ba47-d76b27da8817 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:26.736553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a3f1690c-b81e-4a58-ba47-d76b27da8817 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013568 Aug 01 15:14:26.743468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 3/3] 10.222.0.100 () {60 vars in 1161 bytes} [Mon Aug 1 15:14:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:14:26.754448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3ff81398-7b11-4d2b-95e6-2683cd3a3419 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Calling method '.version_select at 0x7efd1efee790>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:27.737261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-3ff81398-7b11-4d2b-95e6-2683cd3a3419 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] HTTP exception thrown: Volume tempest-invalid-1411086554 could not be found. Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3ff81398-7b11-4d2b-95e6-2683cd3a3419 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Request method failure captured: Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1411086554 HTTP/1.1 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RSGbPUQa1wROtJ1XTR6hzjOQN42FA-NMroL8RrEoGczCuGhrMZZe5kTZG-Cjco7zD-3Ym1pwxT0v_WraCE0ees873iB8vTTmau2ApAVPExe9900xaM1vpj-Yq3Q7XiK9ul7tH1yNFgHUuL5aSjykKNjP-yV0FniOJMp0CEhPAY48 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:27.744249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b7d2693930994c6c990461c488626517", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b7d2693930994c6c990461c488626517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 47f5aec582c742b18cb17bddd77f2891 Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Volume tempest-invalid-1411086554 could not be found. Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'tempest-invalid-1411086554'} Aug 01 15:14:27.745610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1411086554 could not be found. (HTTP 404) (Request-ID: req-b36c8617-c6d2-4165-a02b-837c8b2df053) Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:27.746403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:27.749122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1411086554 could not be found. Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:27.751756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1411086554 could not be found. Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1411086554 could not be found. Aug 01 15:14:27.753886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.758260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3ff81398-7b11-4d2b-95e6-2683cd3a3419 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Returning 404 to user: Volume tempest-invalid-1411086554 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:27.759782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3ff81398-7b11-4d2b-95e6-2683cd3a3419 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1411086554" status: 404 len: 99 microversion: 2.1 time: 1.015202 Aug 01 15:14:27.763289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 4/4] 10.222.0.100 () {58 vars in 1223 bytes} [Mon Aug 1 15:14:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1411086554 => generated 99 bytes in 1019 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:14:27.782821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ecbbac1d-c257-4981-8c15-01dfa07e6505 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013134 Aug 01 15:14:27.785249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 5/5] 10.222.0.100 () {58 vars in 1145 bytes} [Mon Aug 1 15:14:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:14:27.800691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-09ec8c2d-23b2-41d2-8193-423f8a3fb52d tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010281 Aug 01 15:14:27.804538 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 6/6] 10.222.0.100 () {58 vars in 1142 bytes} [Mon Aug 1 15:14:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:14:27.817820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1876dd5e-914b-4993-aad3-d01bf6ebf93c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Calling method '.version_select at 0x7efd1ef21d30>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:27.888697 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0659c551-bf0a-4b9c-8b78-c330a4c29233 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.763088 Aug 01 15:14:27.889577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 1/7] 10.222.0.100 () {60 vars in 1161 bytes} [Mon Aug 1 15:14:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2766 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 01 15:14:27.908617 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-68b34792-69fc-4564-8a6a-232625fe2fce tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1ef9ed30>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:27.944588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-1876dd5e-914b-4993-aad3-d01bf6ebf93c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] HTTP exception thrown: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1876dd5e-914b-4993-aad3-d01bf6ebf93c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Request method failure captured: Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/os-volumes/e82def94-57a7-4252-b8cb-88e591fba871 HTTP/1.1 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RSGbPUQa1wROtJ1XTR6hzjOQN42FA-NMroL8RrEoGczCuGhrMZZe5kTZG-Cjco7zD-3Ym1pwxT0v_WraCE0ees873iB8vTTmau2ApAVPExe9900xaM1vpj-Yq3Q7XiK9ul7tH1yNFgHUuL5aSjykKNjP-yV0FniOJMp0CEhPAY48 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:27.947380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b7d2693930994c6c990461c488626517", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b7d2693930994c6c990461c488626517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 47f5aec582c742b18cb17bddd77f2891 Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'e82def94-57a7-4252-b8cb-88e591fba871'} Aug 01 15:14:27.948752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. (HTTP 404) (Request-ID: req-a3235e15-4a50-407e-af74-71adb075a459) Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:27.949524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:27.950632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:14:27.951752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1876dd5e-914b-4993-aad3-d01bf6ebf93c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Returning 404 to user: Volume e82def94-57a7-4252-b8cb-88e591fba871 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1876dd5e-914b-4993-aad3-d01bf6ebf93c tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/e82def94-57a7-4252-b8cb-88e591fba871" status: 404 len: 109 microversion: 2.1 time: 0.139129 Aug 01 15:14:27.952847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 7/8] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:14:27 2022] DELETE /compute/v2.1/os-volumes/e82def94-57a7-4252-b8cb-88e591fba871 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:27.965953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-814b2770-42a7-4773-ba07-26b65556bb14 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Calling method '.version_select at 0x7efd1ef21ca0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:28.053831 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-68b34792-69fc-4564-8a6a-232625fe2fce tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 200 len: 352 microversion: 2.1 time: 0.149271 Aug 01 15:14:28.055023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 2/9] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:27 2022] GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:14:28.082036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-814b2770-42a7-4773-ba07-26b65556bb14 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] HTTP exception thrown: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-814b2770-42a7-4773-ba07-26b65556bb14 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Request method failure captured: Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/os-volumes/913fe16d-f041-4bac-adea-4431ce0d0f25 HTTP/1.1 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RSGbPUQa1wROtJ1XTR6hzjOQN42FA-NMroL8RrEoGczCuGhrMZZe5kTZG-Cjco7zD-3Ym1pwxT0v_WraCE0ees873iB8vTTmau2ApAVPExe9900xaM1vpj-Yq3Q7XiK9ul7tH1yNFgHUuL5aSjykKNjP-yV0FniOJMp0CEhPAY48 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:28.085092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b7d2693930994c6c990461c488626517", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b7d2693930994c6c990461c488626517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b7d2693930994c6c990461c488626517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b7d2693930994c6c990461c488626517 Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesNegativeTest-46614082 Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 47f5aec582c742b18cb17bddd77f2891 Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesNegativeTest-46614082-project Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '913fe16d-f041-4bac-adea-4431ce0d0f25'} Aug 01 15:14:28.086672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. (HTTP 404) (Request-ID: req-0f11cae7-8e1a-4dc1-a0b2-1510602b3692) Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:28.087632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:14:28.089008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:14:28.091178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. Aug 01 15:14:28.092536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:28.095661 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-814b2770-42a7-4773-ba07-26b65556bb14 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] Returning 404 to user: Volume 913fe16d-f041-4bac-adea-4431ce0d0f25 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:28.095661 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-814b2770-42a7-4773-ba07-26b65556bb14 tempest-VolumesNegativeTest-46614082 tempest-VolumesNegativeTest-46614082-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/913fe16d-f041-4bac-adea-4431ce0d0f25" status: 404 len: 109 microversion: 2.1 time: 0.139882 Aug 01 15:14:28.095661 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 8/10] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:27 2022] GET /compute/v2.1/os-volumes/913fe16d-f041-4bac-adea-4431ce0d0f25 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:29.068920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-643ee3a0-5955-4ae2-8666-ce3402d6e9cd tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1efae430>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:29.165634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-643ee3a0-5955-4ae2-8666-ce3402d6e9cd tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 200 len: 352 microversion: 2.1 time: 0.100841 Aug 01 15:14:29.166679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 3/11] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:29 2022] GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:30.194036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2cb49f6d-6a74-4f12-8b57-4f574411f248 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1efee3a0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:30.344354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2cb49f6d-6a74-4f12-8b57-4f574411f248 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 200 len: 353 microversion: 2.1 time: 0.166925 Aug 01 15:14:30.346022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 9/12] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:30 2022] GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:30.359489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-35264a78-4b4b-45ff-9ff7-fafead5f101b tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1efaeaf0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:30.497141 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-35264a78-4b4b-45ff-9ff7-fafead5f101b tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 200 len: 353 microversion: 2.1 time: 0.143081 Aug 01 15:14:30.497858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 4/13] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:30 2022] GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:30.518965 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4d3de7f6-a1cb-480e-8718-91675358fc02 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1ef21280>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:30.668969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4d3de7f6-a1cb-480e-8718-91675358fc02 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 202 len: 0 microversion: 2.1 time: 0.154349 Aug 01 15:14:30.672524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 10/14] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:14:30 2022] DELETE /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:14:30.692594 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0f283a9a-94a2-44c2-963b-c9c8271e6eb6 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1efaed30>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:30.862834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0f283a9a-94a2-44c2-963b-c9c8271e6eb6 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 200 len: 352 microversion: 2.1 time: 0.185303 Aug 01 15:14:30.879623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 5/15] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:30 2022] GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 352 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:31.877873 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-813e86a8-df8b-4fb9-8dc7-0f290c9701f8 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Calling method '.version_select at 0x7efd1ef3f280>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:31.947516 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-813e86a8-df8b-4fb9-8dc7-0f290c9701f8 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] HTTP exception thrown: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-813e86a8-df8b-4fb9-8dc7-0f290c9701f8 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Request method failure captured: Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 HTTP/1.1 Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3RXlX_wS65Aym5Rt0_Snko4mkL9q0Y9udgURFkfpmhBjcIXVQvbIRwqCLqz0AAoa2oMM1quM4w3-b_E6RMEEhC11ZcCtOMHk8_vp4iqKaxbufhr0pEOQ-DFa7mIrNU847y6HJUy4TswBIwC0viR0Yr4dzRfJJ0BTlomGOOLFGgmTw Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 696478725b424726a5c81d6ea974f819 Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesGetTestJSON-2095350869 Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:14:31.951013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_696478725b424726a5c81d6ea974f819", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/696478725b424726a5c81d6ea974f819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/696478725b424726a5c81d6ea974f819"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/696478725b424726a5c81d6ea974f819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesGetTestJSON-2095350869 Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 696478725b424726a5c81d6ea974f819 Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesGetTestJSON-2095350869 Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesGetTestJSON-2095350869-project Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: aed8ce0800f8449fb1319bcb7ee3d9e5 Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesGetTestJSON-2095350869-project Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'bddb833f-4866-432d-b41a-9972a932a084'} Aug 01 15:14:31.952113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. (HTTP 404) (Request-ID: req-f41cc872-2d35-49ff-a6b6-7e2528bd39dc) Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:31.952780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:14:31.953687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:14:31.954567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. Aug 01 15:14:31.955501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:14:31.958283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-813e86a8-df8b-4fb9-8dc7-0f290c9701f8 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] Returning 404 to user: Volume bddb833f-4866-432d-b41a-9972a932a084 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:31.959368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-813e86a8-df8b-4fb9-8dc7-0f290c9701f8 tempest-VolumesGetTestJSON-2095350869 tempest-VolumesGetTestJSON-2095350869-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084" status: 404 len: 109 microversion: 2.1 time: 0.085755 Aug 01 15:14:31.960568 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 11/16] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:14:31 2022] GET /compute/v2.1/os-volumes/bddb833f-4866-432d-b41a-9972a932a084 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:42.608728 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1088789112", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "networks": [{"uuid": "a5206ee7-90a4-45bc-b7d9-49ac048e20b9"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:42.900023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] validate_networks() for [('a5206ee7-90a4-45bc-b7d9-49ac048e20b9', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:14:43.404356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-166141730", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:43.655843 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] validate_networks() for [('cfb293c1-f2bd-4025-8b87-d35edaff94c1', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:14:45.348522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:14:45.349025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:14:45.350052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:14:45.350467 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:14:45.351060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:14:45.401476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:45.401934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:45.415061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:45.415361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:45.484313 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Getting quotas for project 85a7e64a4f0a43599f9eeeb99e695f24. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:45.492679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Getting quotas for user e8fc60410fab43a39bdb80478348ddae and project 85a7e64a4f0a43599f9eeeb99e695f24. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:45.515178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:14:45.519134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:14:45.644077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-093cf003-7b06-47b6-b164-e0f8c850677c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.600204 Aug 01 15:14:45.646493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 6/17] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:14:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 3604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:14:46.261116 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:14:46.262727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:14:46.263485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:14:46.264085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:14:46.264848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:14:46.295338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c33db656-df16-4118-bcbb-7da4e9460aec tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: .version_select at 0x7efd1e6b38b0>, body: {"keypair": {"name": "tempest-keypair-1878869037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoGxdzEnmiDqEHIvFY5HHyGij3ynqGdzVhBp6cB3NT+IghAEmlvjUeI4N2XNShukHungbzDW9Xv2YK0sCeMSreDnFAL0r5pvyr8d3+XsAeG2oIvLFETam4CpSn4obcVpA=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:46.295748 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:46.296504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:46.297621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:46.299380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:46.367908 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-c33db656-df16-4118-bcbb-7da4e9460aec tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:46.387210 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-c33db656-df16-4118-bcbb-7da4e9460aec tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for user f33ea26c1f72445bb4cb50ea503600dc and project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:46.401062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:46.417820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for user ca1d32ee23bc42b38ea9a043f7a850f5 and project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:46.455148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:14:46.464511 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:14:46.512300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c33db656-df16-4118-bcbb-7da4e9460aec tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.862852 Aug 01 15:14:46.528209 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 7/18] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:14:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:46.661848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4a89a8e2-c264-4971-87a6-f9979e0d1b83 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.636874 Aug 01 15:14:46.663351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 12/19] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:14:43 2022] POST /compute/v2.1/servers => generated 385 bytes in 3640 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:14:46.701279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4f455861-be01-4a4f-a94c-d67d7ecb4231 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:46.702001 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4f455861-be01-4a4f-a94c-d67d7ecb4231 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:47.301763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-018f4978-8cc8-478d-b131-baa36b9a29a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'create', calling method: .version_select at 0x7efd1e6b3f70>, body: {"keypair": {"name": "tempest-keypair-989922037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm2kViCFphss+QxQTRPAu3x6OKDh5MDH/nYUL/ZbbQIkuAdpVE1uuppUS/8FWxNQV2ghJ4RYsO9yFpy76u6euS77l1YrWxgTf5+iFSHyYDdMbjYKUq45G9zS/LBcljCQg=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:47.352622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4f455861-be01-4a4f-a94c-d67d7ecb4231 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:47.362519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-018f4978-8cc8-478d-b131-baa36b9a29a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:47.378271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-018f4978-8cc8-478d-b131-baa36b9a29a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for user 424ccf230e16423a8dd32097d90c4995 and project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:47.418020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4f455861-be01-4a4f-a94c-d67d7ecb4231 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1219 microversion: 2.1 time: 0.750729 Aug 01 15:14:47.425413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 13/20] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:46 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1219 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:47.431895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-018f4978-8cc8-478d-b131-baa36b9a29a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.902283 Aug 01 15:14:47.441893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 8/21] 10.222.0.100 () {62 vars in 1205 bytes} [Mon Aug 1 15:14:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 910 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:14:47.460985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-30943a07-1316-43aa-8904-a77fc7f6e727 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:47.464415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-30943a07-1316-43aa-8904-a77fc7f6e727 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:47.763424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-30943a07-1316-43aa-8904-a77fc7f6e727 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:47.774981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-30943a07-1316-43aa-8904-a77fc7f6e727 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1225 microversion: 2.1 time: 0.341732 Aug 01 15:14:47.776442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 14/22] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:47 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1225 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:48.179270 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1850887274", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:48.338155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] validate_networks() for [('cfb293c1-f2bd-4025-8b87-d35edaff94c1', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:14:48.453027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:48.454459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:48.465466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:48.466110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:48.467103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:48.467693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:48.842507 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:48.864326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-47d6dff2-cb85-45e8-8f7f-be2c17e01c8b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1223 microversion: 2.1 time: 0.415833 Aug 01 15:14:48.866307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 15/23] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:48 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1223 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:49.893795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:49.896702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:49.913738 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:49.914535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:49.915735 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:49.917533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:50.211187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:14:50.211734 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:14:50.212090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:14:50.212500 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:14:50.212911 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:14:50.252733 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:50.253107 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:50.253925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:50.254362 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:50.289304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:50.306293 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b8ec7d34-cdbb-44ef-bac3-7d355e108939 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1215 microversion: 2.1 time: 0.424122 Aug 01 15:14:50.308390 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 16/24] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:49 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1215 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:50.361721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:50.381718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for user ca1d32ee23bc42b38ea9a043f7a850f5 and project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:50.418742 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:14:50.421023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:14:50.623463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40afa685-5060-4f70-a807-76ddb422e599 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.456368 Aug 01 15:14:50.636551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 9/25] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:14:48 2022] POST /compute/v2.1/servers => generated 385 bytes in 2470 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:14:50.641392 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c28f3576-37f4-40a3-ba0d-eccca73848a9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:50.642023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c28f3576-37f4-40a3-ba0d-eccca73848a9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:50.788028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c28f3576-37f4-40a3-ba0d-eccca73848a9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:50.795626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c28f3576-37f4-40a3-ba0d-eccca73848a9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1226 microversion: 2.1 time: 0.157988 Aug 01 15:14:50.798587 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 17/26] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:50 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:51.330468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:51.340720 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:51.379044 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:51.382220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:51.383334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:51.386931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:51.827756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-24e0e1d5-6555-4564-ad17-7864f6dc6097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:51.829793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-24e0e1d5-6555-4564-ad17-7864f6dc6097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:51.994517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:52.048581 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-67493e65-cbe1-435c-86e7-28d79ad2165d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1289 microversion: 2.1 time: 0.722154 Aug 01 15:14:52.059345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 10/27] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:51 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1289 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:52.113673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-24e0e1d5-6555-4564-ad17-7864f6dc6097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:52.127350 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-24e0e1d5-6555-4564-ad17-7864f6dc6097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1226 microversion: 2.1 time: 0.307705 Aug 01 15:14:52.128768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 18/28] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:51 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1226 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:53.085680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:53.086612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:53.093807 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1841354224", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5b35e26-bb0e-4039-aefb-c5e5ee561d48"}], "security_groups": [{"name": "tempest-securitygroup--359112118"}], "key_name": "tempest-keypair-989922037", "user_data": "}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:53.119106 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.119847 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.123905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.126523 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.495335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] validate_networks() for [('e5b35e26-bb0e-4039-aefb-c5e5ee561d48', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:14:53.805460 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:53.815594 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-43f48310-deed-4d17-baed-631684d8a1be tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1277 microversion: 2.1 time: 0.734239 Aug 01 15:14:53.822009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 11/29] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:53 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1277 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:53.830515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:53.836373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:53.857644 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.859631 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.863337 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.864166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:54.326022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:54.347645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cfea5b25-153d-4397-8046-ecbcb765bb49 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1284 microversion: 2.1 time: 0.523210 Aug 01 15:14:54.360218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 12/30] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:53 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1284 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:54.851700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:54.852413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:54.878232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:54.879193 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:54.890743 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:54.896315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:55.145613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:55.157272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ceb12d3-a2bd-4ac4-8d37-a304c1f6e3df tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1277 microversion: 2.1 time: 0.307602 Aug 01 15:14:55.159880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 13/31] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:54 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1277 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:55.396771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:55.399609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:55.438330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:55.451208 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:55.463918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:55.464400 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:55.727883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:55.741497 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8d9bc846-9d54-4daa-888b-12a8f20036e5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1284 microversion: 2.1 time: 0.357376 Aug 01 15:14:55.747751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 14/32] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:55 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:55.956035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:14:55.957164 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:14:55.958284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:14:55.958943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:14:55.959519 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:14:56.011788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:56.017236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:56.021093 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:56.023982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:56.178040 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:56.186972 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:56.187631 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:56.197167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for user 424ccf230e16423a8dd32097d90c4995 and project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:56.200501 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:56.202920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:56.203992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:56.208088 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:56.257467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:14:56.265045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:14:56.420919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2bcc88aa-0df5-467a-996c-a9f424a4e1b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 3.330245 Aug 01 15:14:56.424774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 19/33] 10.222.0.100 () {62 vars in 1193 bytes} [Mon Aug 1 15:14:53 2022] POST /compute/v2.1/servers => generated 403 bytes in 3335 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 01 15:14:56.445246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a1fbfca0-e0e5-4038-a27c-50aa9a56930c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:56.446230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a1fbfca0-e0e5-4038-a27c-50aa9a56930c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:56.925801 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a1fbfca0-e0e5-4038-a27c-50aa9a56930c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:56.938486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a1fbfca0-e0e5-4038-a27c-50aa9a56930c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:56.941121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a1fbfca0-e0e5-4038-a27c-50aa9a56930c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:56.951841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a1fbfca0-e0e5-4038-a27c-50aa9a56930c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1285 microversion: 2.20 time: 0.519479 Aug 01 15:14:56.952645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 20/34] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:14:56 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1285 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:14:56.966291 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1052708860", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd5fc8a7-9a70-4b95-a2b2-41f8b1f20c21"}], "security_groups": [{"name": "tempest-securitygroup--70835329"}], "key_name": "tempest-keypair-1878869037", "user_data": "}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:58.169717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:58.179168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-78753cfa-7a6b-452b-903a-04fb81c2216c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 1.995297 Aug 01 15:14:58.185362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] validate_networks() for [('dd5fc8a7-9a70-4b95-a2b2-41f8b1f20c21', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:14:58.194652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 15/35] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:56 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:58.206563 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:58.207565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:58.222406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.222977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.224115 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.225942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.339381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:58.360249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eac8debc-88d1-4272-a3e8-6c53bd7522bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1284 microversion: 2.1 time: 0.162868 Aug 01 15:14:58.364187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 16/36] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:58 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:58.375106 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:58.381729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:58.410760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.419312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.429960 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.433489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.626929 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:58.637516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:58.639121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:58.645041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d88a7a09-2e2f-4c90-85ac-821656ab3b51 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1289 microversion: 2.20 time: 0.275629 Aug 01 15:14:58.645629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 17/37] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:14:58 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1289 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:14:59.205875 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:59.215027 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:59.237361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.244233 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.247012 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.248804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.688217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:14:59.689255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:14:59.689949 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:14:59.690767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:14:59.691183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:14:59.715839 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.716779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.717745 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.718520 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.730521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:59.750068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd2fc4a5-bded-4705-bd9c-0c28f0a37870 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.543248 Aug 01 15:14:59.750765 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 18/38] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:59 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:59.761921 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:59.762898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:59.774834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.776046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.776762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.777199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.789330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:14:59.794464 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for user f33ea26c1f72445bb4cb50ea503600dc and project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:14:59.810858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:14:59.826909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:14:59.945153 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bc29d80f-6231-48fc-810b-19552e992384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.989424 Aug 01 15:14:59.946989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 21/39] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:14:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2992 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:14:59.966293 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:59.966977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:59.994923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.998175 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.999152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:00.000293 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:00.060355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:00.070033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc41de31-47ea-41ce-af56-ee309e4141bb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.311990 Aug 01 15:15:00.074363 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 19/40] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:14:59 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:00.092014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2e7e9365-9917-4071-8a87-891fb0c3557b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:00.092640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2e7e9365-9917-4071-8a87-891fb0c3557b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:00.128077 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:00.136952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:00.138553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:00.139698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5396752a-26fa-4b88-8149-5c13eda146c4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1289 microversion: 2.20 time: 0.190405 Aug 01 15:15:00.140251 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 22/41] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:14:59 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1289 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:00.197070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e7e9365-9917-4071-8a87-891fb0c3557b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:00.209650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2e7e9365-9917-4071-8a87-891fb0c3557b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1242 microversion: 2.1 time: 0.133924 Aug 01 15:15:00.210302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 20/42] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:00 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:00.780604 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:00.783481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:00.799352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:00.799978 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:00.801055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:00.801887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.001641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.009470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7c7c5233-8221-42e9-a7a9-da15add2ecfe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.236511 Aug 01 15:15:01.011395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 23/43] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:00 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:01.096075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:01.096784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:01.098776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:01.104919 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.105580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.111178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.113707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.164989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:01.165665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:01.173145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.173917 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.174941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.175588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.312130 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.329494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.333492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.336967 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9b2fc921-d61d-4f5d-ad06-ad696fe695a4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.175470 Aug 01 15:15:01.352015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 24/44] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:01 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:01.352015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:01.367916 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:01.383741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.387901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.389590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.394949 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.395229 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.407021 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-201a1ccd-d270-4be5-9030-7e0a7e48a60c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.314439 Aug 01 15:15:01.408985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 21/45] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:01 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:01.481037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.488702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-77e8f86d-6e3e-42fe-b4ea-f2a5e2d1f1bf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.147959 Aug 01 15:15:01.489297 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 25/46] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:01 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:02.037889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.039437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.046310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.047282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.048508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.049194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.192635 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.200128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-966a0f50-8fdb-4d86-bcdc-9142021a677a tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.166586 Aug 01 15:15:02.200694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 22/47] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:02.370634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.371995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.378249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.378727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.379503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.379940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.428275 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.429664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.436940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.437635 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.438553 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.439042 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.446466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.455934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.457729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.458880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c2ea489d-6d67-4674-baa8-426803c70b7f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.092216 Aug 01 15:15:02.460250 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 26/48] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:02.511528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.512488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.520138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.521805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.522827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.523264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.595173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.607838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-93d048d7-be04-42b3-8381-21b4d35b3c07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.101735 Aug 01 15:15:02.608427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 27/49] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:02.625246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.636424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2d47be77-1622-4714-a95a-4386cac58d78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.211987 Aug 01 15:15:02.652327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 23/50] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:03.221242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.221934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.228887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.229421 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.230298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.230826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.370195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.377672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6733a330-b6e8-48f2-ae71-61d3b6884143 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.160226 Aug 01 15:15:03.378324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 28/51] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:03.482031 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.482645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.488772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.489269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.490021 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.490459 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.557849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.567401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.568923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.570033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f9bc0b03-ac8c-4156-9f3b-b2e0b979db3e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.092586 Aug 01 15:15:03.570788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 24/52] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:03.628628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.629271 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.636204 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.636648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.637843 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.643184 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.661474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.662133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.669201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.669857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.670945 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.677935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.727842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.750628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4fc1b854-11c2-4087-9ece-712e5e451592 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.125772 Aug 01 15:15:03.751768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 29/53] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:03.868271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.876211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-12e20fc4-ca7b-4bb9-bb76-f17a40572a94 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.219203 Aug 01 15:15:03.876773 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 25/54] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:04.405062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.406335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.413935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.414381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.415210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.415838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.558493 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:04.566201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a85ddae2-8ecf-4f58-a7a4-07fa0bf860de tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.168437 Aug 01 15:15:04.567126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 30/55] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:04.595030 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.596249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.602967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.604305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.605189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.605836 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.675164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:04.678608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:04.684966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:04.686480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:04.687733 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2ae3ffdf-76f8-4fc2-9f21-3303d8f29bc8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.097139 Aug 01 15:15:04.688287 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 26/56] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:04.772348 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.773221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.779222 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.779711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.780472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.780935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.845010 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:04.856294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-186435cd-ea09-471f-876c-afbb8cdc26e2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.087622 Aug 01 15:15:04.861303 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 31/57] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:04.898589 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.899891 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.907487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.907935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.908700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.909129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.126293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.142419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8d7cfc36-23a5-4c79-a334-6834708602c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.247169 Aug 01 15:15:05.144749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 27/58] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:05.594478 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:05.595122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:05.601340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.601697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.602653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.603393 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.709893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:05.710531 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:05.717897 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.719676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.722642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.723854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.777632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.793653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dfc7ef35-5689-416f-888b-bcebcf7c09fe tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.203604 Aug 01 15:15:05.794242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 32/59] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:05 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:05.847813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.855933 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.857459 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.858859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6becd8f6-b806-4ec7-ae64-9558fa599f99 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.153119 Aug 01 15:15:05.859411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 28/60] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:05 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:05.880819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:05.881633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:05.885419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:05.889298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.889972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.890777 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.891306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.963111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.970528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-06bb5dac-38c5-4356-8a34-cf147619b20e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.093553 Aug 01 15:15:05.971144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 33/61] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:05 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:06.168555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:06.169221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:06.176511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.177180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.178096 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.178682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.400696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:06.410082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-deb81690-c3b5-4f6f-932c-0a3537b4b552 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.245025 Aug 01 15:15:06.412257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 29/62] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:06 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:06.817163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:06.817763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:06.824966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.825425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.826494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.826938 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.885846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:06.886554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:06.890554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:06.907631 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.909186 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.911419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.913564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.006323 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.021958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.022487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.023548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.024714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd73e8ec-821f-4412-b2b5-57725c9e409f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.143703 Aug 01 15:15:07.026258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 30/63] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:06 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:07.031812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:07.032302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:07.036448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c03d59ed-4d1c-4400-8fc3-323738789be5 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.222946 Aug 01 15:15:07.037324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 34/64] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:06 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:07.041914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.042526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.043815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.044397 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.120729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.128888 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-90b455a4-89c6-4387-9874-a026d6da3112 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.101845 Aug 01 15:15:07.142001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 31/65] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:07 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:07.438989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:07.440129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:07.454586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.455960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.456922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.461206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.499793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:07.685971 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.696490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c190aaaf-00c7-44e1-bfe1-3c86a18bf375 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.267110 Aug 01 15:15:07.699167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 35/66] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:07 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:08.058646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:08.059444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:08.062119 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:08.063316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:08.067290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.067908 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.068708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.069142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.069489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.069945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.070751 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.071190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.331860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.340894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.342711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.344054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-87b7d205-e74c-4bf3-bf34-08f3931dd337 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.286151 Aug 01 15:15:08.345029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 36/67] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:08 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:08.350160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:08.350791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:08.357757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.358197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.358996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.359425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.420155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.428401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe71ab7b-e2c8-4dc7-9f39-1f0598f96121 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.373972 Aug 01 15:15:08.429667 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 32/68] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:08 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:08.442319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.451012 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-be493fb3-6798-4f71-b341-a80749a52328 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.104756 Aug 01 15:15:08.451598 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 37/69] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:08 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:08.719495 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:08.720097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:08.730890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.730890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.730890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.730890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.890976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.898450 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d89543f2-a5e5-4db2-8ce0-b9066a8c7200 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.183366 Aug 01 15:15:08.899054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 33/70] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:08 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:09.370691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.371837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.378925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.379611 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.380628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.381338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.455444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.456059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.457597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.463536 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.464134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.464909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.465340 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.467039 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.468786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.469969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-43c8956d-dfb1-47bb-ab46-c7a1c64c4149 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.104510 Aug 01 15:15:09.470794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 38/71] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:09.475913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.476658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.483690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.485163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.486161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.486837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.582926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.591684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2cda5f1e-10fc-4441-9c37-e652cb2662a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.119326 Aug 01 15:15:09.592345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 39/72] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:09.645686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.653983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8996605c-3b1d-47ab-84d3-ba94dd2078b4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.204555 Aug 01 15:15:09.654562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 34/73] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:09.919252 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.919865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.921770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:09.922626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=28 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:09.929043 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.929490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.930256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.930707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.069190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.077444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-90f6b17d-5915-4d1b-996d-897d857003a3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.162046 Aug 01 15:15:10.078017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 40/74] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:10.495657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:10.496342 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:10.498374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=22 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:10.504617 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.505197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.506017 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.506518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.584445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.592863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.594402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.595562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af42b781-3a32-4428-b1fa-7e68164c9472 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.104853 Aug 01 15:15:10.596915 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 35/75] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:10 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:10.613020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:10.613782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:10.620819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.621399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.622447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.623091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.676185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:10.676825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:10.683898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.685518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.686514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.686976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.687160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.694642 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7a716415-478e-4ef6-b9e5-e931953a7376 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.086155 Aug 01 15:15:10.695469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 41/76] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:10 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:10.825148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.833119 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-88c89089-6b31-49ce-814b-c98a5d331ddb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.160723 Aug 01 15:15:10.833844 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 36/77] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:10 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:11.100783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:11.101486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:11.108346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.108877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.109766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.110306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.256460 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.266337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1adb5214-dff7-455f-94ec-378365a0a02f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.170177 Aug 01 15:15:11.267174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 42/78] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:11 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:11.619429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:11.620059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:11.626179 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.626629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.627428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.627866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.689337 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.698608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.700195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.701306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1a36355a-c782-463a-aed3-2fc2ea440e91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1281 microversion: 2.20 time: 0.086427 Aug 01 15:15:11.701860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 37/79] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:11 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:11.717247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:11.718078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:11.724096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.724531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.725369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.725822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.798154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.818814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e53a298e-5733-4951-8e29-7203bb96d576 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1246 microversion: 2.1 time: 0.106183 Aug 01 15:15:11.819898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 43/80] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:11 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:11.855412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:11.856103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:11.862829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.863832 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.864682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.865816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.073061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.082956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b9f5f5d5-6028-4b11-887e-014f73b3dcec tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.231884 Aug 01 15:15:12.084619 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 38/81] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:11 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:12.288838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:12.290247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:12.301138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.302554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.304708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.306899 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.622083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.634591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e84fd0c6-6d8b-4505-8ea2-0474fc37dda5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.349317 Aug 01 15:15:12.635804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 44/82] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:12 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:12.727146 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:12.729429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:12.742918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.744554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.748010 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.748887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.843679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:12.844297 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:12.860692 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.861136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.861894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.862333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.905413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.923610 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.930474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.935927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94c3aa27-af44-4690-a824-24e8a4906248 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1345 microversion: 2.20 time: 0.212953 Aug 01 15:15:12.936526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 39/83] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:12 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:12.961138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.974946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5de178ba-68e0-451c-a73e-b66b62c6d8b0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1302 microversion: 2.1 time: 0.136850 Aug 01 15:15:12.977539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 45/84] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:12 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:13.110100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:13.110747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:13.123696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.127329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:13.131200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.136906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:13.473975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:13.489683 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a61943d2-9213-4075-845a-fced79788579 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.383549 Aug 01 15:15:13.492168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 40/85] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:13 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:13.665145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:13.668103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:13.683698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.689054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:13.691827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.694061 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.168577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-7bb90b64-73c0-4dcb-9aaa-9f4e40106374 req-14d031b8-9e1b-4fa8-8125-7941bc27470c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40bc31b-5c78-49e5-99ea-0cc891add3c4", "tag": "d51788c4-39dd-4128-bdbc-fb2980d56261"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:14.245066 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7bb90b64-73c0-4dcb-9aaa-9f4e40106374 req-14d031b8-9e1b-4fa8-8125-7941bc27470c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.253014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7bb90b64-73c0-4dcb-9aaa-9f4e40106374 req-14d031b8-9e1b-4fa8-8125-7941bc27470c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.308361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-7bb90b64-73c0-4dcb-9aaa-9f4e40106374 req-14d031b8-9e1b-4fa8-8125-7941bc27470c service nova] Creating event network-changed:d51788c4-39dd-4128-bdbc-fb2980d56261 for instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 on hv-cinder-84327 Aug 01 15:15:14.309380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7bb90b64-73c0-4dcb-9aaa-9f4e40106374 req-14d031b8-9e1b-4fa8-8125-7941bc27470c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:15:14.311490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.312391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.313900 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.314858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.329820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.compute.rpcapi [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:15:14.331465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] Releasing lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:15:14.378791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e76302dc-9795-462e-a087-9009aac47b7c None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.497343 Aug 01 15:15:14.379662 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 41/86] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:14.387099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.395118 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:14.400706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5d57b54f-d57d-402b-894f-6a7a59826e81 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.743408 Aug 01 15:15:14.401762 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 46/87] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:13 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:14.403988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:14.410554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.411309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.412208 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.412770 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.420175 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:14.422152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:14.432697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.433219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.434158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.439483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.621685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.640231 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.653512 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-56c1b1ab-fee0-45d4-9ad3-d1ca49ef608b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1300 microversion: 2.1 time: 0.250319 Aug 01 15:15:14.665478 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.666494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 47/88] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:14 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:14.669953 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.671381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-21002b65-e23f-4f85-94e8-4caa568498c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1343 microversion: 2.20 time: 0.290097 Aug 01 15:15:14.671927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 42/89] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:14 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1343 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:14.686176 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:14.687634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:14.716626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.717295 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.723005 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.723662 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.096030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.119117 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e3d74d8e-f972-46a9-9e0b-30caf84d6748 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.448721 Aug 01 15:15:15.136204 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 48/90] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:14 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:15.326872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e0ed651c-9af5-4d5d-af4d-4f4d885b607a req-15191a02-d831-4029-b090-52b8893d6b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f6aeb2-92b5-4698-a380-4267e8765034", "tag": "0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:15.339869 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e0ed651c-9af5-4d5d-af4d-4f4d885b607a req-15191a02-d831-4029-b090-52b8893d6b6c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.340399 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e0ed651c-9af5-4d5d-af4d-4f4d885b607a req-15191a02-d831-4029-b090-52b8893d6b6c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.353288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e0ed651c-9af5-4d5d-af4d-4f4d885b607a req-15191a02-d831-4029-b090-52b8893d6b6c service nova] Creating event network-changed:0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca for instance 41f6aeb2-92b5-4698-a380-4267e8765034 on hv-cinder-84327 Aug 01 15:15:15.358507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-e0ed651c-9af5-4d5d-af4d-4f4d885b607a req-15191a02-d831-4029-b090-52b8893d6b6c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113435 Aug 01 15:15:15.359578 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 43/91] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:15.431718 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:15.432883 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:15.443780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.444727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.446114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.447603 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.682351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.688345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:15.692404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:15.701689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c7698219-9e6a-42fd-9685-2a8032bb6f4a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.274527 Aug 01 15:15:15.702625 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 49/92] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:15 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:15.704177 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.705008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.706085 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.706848 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.718901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:15.721436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:15.739482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:15.740340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.740846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.744560 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.746205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.084453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.100453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.101962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.103434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.103721 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-920cbba6-e706-4c75-8c43-69784afddeec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.397080 Aug 01 15:15:16.104840 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 50/93] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:15 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:16.119389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-34175d34-44e7-4aa1-a71c-7c0460750cb4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.436871 Aug 01 15:15:16.121230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 44/94] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:15 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:16.145723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:16.146702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:16.152746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.153534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.154515 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.155099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.352320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.364941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-51022673-1ce9-43be-a52e-7b4ca80e88f8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.222561 Aug 01 15:15:16.366003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 51/95] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:16 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:16.725939 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:16.726828 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:16.733699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.734413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.735384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.736138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.907779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.919362 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d16835bb-492d-45cf-b1ba-314f42d68714 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.197092 Aug 01 15:15:16.920934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 45/96] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:16 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:17.144767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:17.149836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:17.152626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:17.152758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:17.158197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.158649 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.159444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.159871 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.172271 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.173354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.174329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.174946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.179494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:17.473574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:17.476594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:17.487514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:17.489039 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:17.491232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0d8eeffe-b3a5-4fc5-a694-d9a476993363 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.367858 Aug 01 15:15:17.492380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b35a4eb0-393d-4868-b2a6-5cfaac088b79 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.354673 Aug 01 15:15:17.497095 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 46/97] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:17 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:17.511430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 52/98] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:17 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:17.515667 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f60be015-fc90-48c7-9c55-6d1dc452d1d7 req-c5bd5694-6ec6-4c6a-80fd-f3ff86faf5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf0433e-acd3-4be5-9bd6-af6c2851084b", "tag": "fed91c7f-477d-4a1c-a51a-755932302fbd"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:17.527335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:17.527780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:17.546813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f60be015-fc90-48c7-9c55-6d1dc452d1d7 req-c5bd5694-6ec6-4c6a-80fd-f3ff86faf5b4 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.547480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f60be015-fc90-48c7-9c55-6d1dc452d1d7 req-c5bd5694-6ec6-4c6a-80fd-f3ff86faf5b4 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.556988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.557439 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.561458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.562720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.591968 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f60be015-fc90-48c7-9c55-6d1dc452d1d7 req-c5bd5694-6ec6-4c6a-80fd-f3ff86faf5b4 service nova] Creating event network-changed:fed91c7f-477d-4a1c-a51a-755932302fbd for instance bbf0433e-acd3-4be5-9bd6-af6c2851084b on hv-cinder-84327 Aug 01 15:15:17.604758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f60be015-fc90-48c7-9c55-6d1dc452d1d7 req-c5bd5694-6ec6-4c6a-80fd-f3ff86faf5b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105757 Aug 01 15:15:17.606334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 47/99] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:17.941727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:17.942856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:17.954935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.955427 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.957414 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.961497 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.992878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:18.001533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-07e04f32-f837-4dea-b04b-936b2d825c9c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.488959 Aug 01 15:15:18.006167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 53/100] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:17 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:18.463601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:18.471638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7ca783d7-ff67-4a1d-8405-c1c64a2917da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.535020 Aug 01 15:15:18.482880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 48/101] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:17 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:18.518639 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:18.519272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:18.524498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:18.525133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:18.534705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.560736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.561186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:18.561964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.562398 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:18.567254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:18.568077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.568506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.353267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:19.367093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:19.378208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-949d5b2e-db1b-4970-b465-5fc9316a54d3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.864681 Aug 01 15:15:19.378808 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 54/102] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:18 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:19.383950 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:19.391655 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:19.395873 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:19.396485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:19.404868 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c4a71e6-3ded-45ef-9de1-a310b3b20f80 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.878027 Aug 01 15:15:19.405520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 49/103] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:18 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:19.438892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:19.439338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.440596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:19.441029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.497387 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:19.497909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:19.513426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:19.513876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.525265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:19.526504 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.879517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:19.895137 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e4b8d613-60f0-4c96-8822-f225ef6e89f1 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.511613 Aug 01 15:15:19.896723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 55/104] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:19 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:19.984678 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-efcfc42e-91e5-429b-90e6-f46c980bde47 req-2e61fbad-8c58-48cd-acd5-8e3dae2486ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d7106b-88eb-481b-aa10-bbfffc0cd9f0", "tag": "afd70030-3dda-4c22-8097-6ed169808ee0"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:20.001010 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-efcfc42e-91e5-429b-90e6-f46c980bde47 req-2e61fbad-8c58-48cd-acd5-8e3dae2486ed service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.001451 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-efcfc42e-91e5-429b-90e6-f46c980bde47 req-2e61fbad-8c58-48cd-acd5-8e3dae2486ed service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.028696 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-efcfc42e-91e5-429b-90e6-f46c980bde47 req-2e61fbad-8c58-48cd-acd5-8e3dae2486ed service nova] Creating event network-changed:afd70030-3dda-4c22-8097-6ed169808ee0 for instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 on hv-cinder-84327 Aug 01 15:15:20.029645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-efcfc42e-91e5-429b-90e6-f46c980bde47 req-2e61fbad-8c58-48cd-acd5-8e3dae2486ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=117887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:15:20.030963 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.031578 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.032514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.033108 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.038076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.049056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2ce45374-2895-4884-9c6d-9a5b85a7d0ae tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.556539 Aug 01 15:15:20.054292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.compute.rpcapi [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:15:20.055482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] Releasing lock "compute-rpcapi-router" {{(pid=117887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:15:20.062889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 50/105] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:19 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:20.071304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-809ebbf6-eb20-4ba7-abf2-5464ffcc1d68 None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091568 Aug 01 15:15:20.072185 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 56/106] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:15:20.148392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e70808d0-67f6-4f57-8c54-72c47f2ca693 req-d8bfbf95-dac6-4dfb-a7d3-076a7dd3f46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50052019-4694-4875-8915-9392814a8aba", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:20.164140 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e70808d0-67f6-4f57-8c54-72c47f2ca693 req-d8bfbf95-dac6-4dfb-a7d3-076a7dd3f46f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.164587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e70808d0-67f6-4f57-8c54-72c47f2ca693 req-d8bfbf95-dac6-4dfb-a7d3-076a7dd3f46f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.183492 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e70808d0-67f6-4f57-8c54-72c47f2ca693 req-d8bfbf95-dac6-4dfb-a7d3-076a7dd3f46f service nova] Creating event network-changed:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:15:20.188910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-e70808d0-67f6-4f57-8c54-72c47f2ca693 req-d8bfbf95-dac6-4dfb-a7d3-076a7dd3f46f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044841 Aug 01 15:15:20.189838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 51/107] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:20.404505 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:20.405269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:20.411690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.412133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.413060 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.413681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.429722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:20.430417 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:20.445740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.446928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.447865 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.448350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.663858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.678185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.697796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.697796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.697796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-97c87dcf-c4e6-4ed9-83ba-e316e5bfa435 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.270925 Aug 01 15:15:20.699314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b14c9101-05ea-41f3-8bf2-aa06c76d9f12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.299460 Aug 01 15:15:20.699983 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 57/108] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:20 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:20.715230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 52/109] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:20 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:20.923728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:20.925920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:20.937225 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.937667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.938589 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.939187 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.072529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:21.073516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:21.080880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.081488 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.082582 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.083065 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.111384 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.119752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6291e2dc-87b9-49d2-853a-c5d4203a672f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.201266 Aug 01 15:15:21.120333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 58/110] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:20 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:21.234014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.244974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b58a49bd-1e35-48e6-9363-1c00987f49dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.178118 Aug 01 15:15:21.245935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 53/111] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:21 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:21.722219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:21.723042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:21.725007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:21.725685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:21.732885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.733404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.733856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.734304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.734920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.735137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.736373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.737291 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.966003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.973204 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.980988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-02977aef-081d-4149-b6ff-6eb8567ed85d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.263483 Aug 01 15:15:21.982208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 59/112] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:21 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:21.984400 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.985910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.987075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b497cb2e-8ac9-4aaf-9d62-cdadf2977089 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.265996 Aug 01 15:15:21.987891 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 54/113] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:21 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:22.142363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:22.143308 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:22.149543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:22.150025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:22.150906 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:22.151237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:22.269549 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:22.270893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:22.277820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:22.278341 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:22.279217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:22.280029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:22.318343 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:22.327358 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-34a18913-dfad-4601-8d51-0e62b826cbeb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.189520 Aug 01 15:15:22.328315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 60/114] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:22 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:22.451707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:22.460031 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5aa368a9-52d3-47ca-a71f-b4e653dd6b2f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.197209 Aug 01 15:15:22.460466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 55/115] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:22 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:23.004016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:23.005510 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:23.012245 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:23.012955 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:23.014305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.015196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.018275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.019825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.020037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.020274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.021327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.022189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.243848 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:23.245948 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:23.255912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:23.256769 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-330c8825-0bd6-4d80-9f25-e14fd9d7bcf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.257882 Aug 01 15:15:23.257906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:23.260096 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d38a8ddd-c067-4c0d-a9d2-4b7ea5d89b63 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.252307 Aug 01 15:15:23.261350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 56/116] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:23 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:23.272680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 61/117] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:22 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:23.354100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:23.355623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:23.365972 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.366830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.368687 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.369466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.481637 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:23.482585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:23.489353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.490064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.490916 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.491513 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.591504 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:23.599374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7f624291-9a20-43d7-b013-a2e580489849 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.252857 Aug 01 15:15:23.599955 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 57/118] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:23 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:23.680511 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:23.692694 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4e4fc191-12f5-4c2b-a671-606111df09a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.214908 Aug 01 15:15:23.693419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 62/119] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:23 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:24.284494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:24.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:24.288481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:24.289068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:24.298783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.301825 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.303061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.303515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.304276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.304920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.305354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.307471 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.350067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:24.571774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.575543 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.584028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.585830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.587766 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b517a6a3-d7a1-49d5-8559-bff52b533525 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.311999 Aug 01 15:15:24.588557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 58/120] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:24 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:24.588699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b3d936ba-c750-4722-9093-f44f6fe1465e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.306304 Aug 01 15:15:24.589322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 63/121] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:24 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:24.621222 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:24.622051 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:24.629042 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.629524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.630291 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.630751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.715966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:24.716724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:24.725098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.725796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.726740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.727382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.846906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.855825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-297d2616-48f6-468f-b061-8f85672c8c18 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.238764 Aug 01 15:15:24.856621 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 59/122] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:24 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:24.953223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.962719 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5b3dc363-b1f5-48bd-b410-a97b74d95253 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.250887 Aug 01 15:15:24.963540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 64/123] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:24 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:25.615834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.618257 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.619549 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:25.620446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:25.632499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.636810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.637993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.638943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.641272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.641731 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.642553 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.643684 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.860377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.873802 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.875773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.877439 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8ba53d23-2ae9-4f8a-85f0-6db4b30cec7d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.269021 Aug 01 15:15:25.878542 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 65/124] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:25.884855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.885834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:25.892935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.893708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.894731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.895991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.906754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.924301 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0d2f3412-f48d-4354-8851-64cb2a3cb371 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.311120 Aug 01 15:15:25.924301 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 60/125] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:25.988201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.990909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:26.005607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.006989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.009412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.010481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.103737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.112219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f821cf4a-f89f-4a2d-ab1d-5163ccb2d711 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.232292 Aug 01 15:15:26.124075 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 66/126] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:26.221385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.231740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a611969e-2cd5-4159-a20b-9f38f44f7e36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.251246 Aug 01 15:15:26.234711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 61/127] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:26.901201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:26.902204 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:26.910237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.910795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.911856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.912382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.943738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:26.954128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:26.966361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.967264 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.968603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.969469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.995653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:27.106365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.122378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.124672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.125969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-339b6442-92da-4847-a70d-8da2ed3a4c7b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.229388 Aug 01 15:15:27.126700 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 67/128] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:26 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:27.136929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:27.138037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:27.148682 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.150066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.151419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.151996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.181132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.189782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-da952e91-3759-4b22-ad81-e71305b1ba97 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.252761 Aug 01 15:15:27.190369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 62/129] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:26 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:27.252345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:27.253152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:27.259520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.260213 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.261192 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.261767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.344626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.355608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e3d727f0-d8cd-4859-aa9d-3cd110bf6d5c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.223852 Aug 01 15:15:27.359217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 68/130] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:27 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:27.427295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.436247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5be12aa1-1a4a-4580-ad59-c3d4983e55e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.187394 Aug 01 15:15:27.436852 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 63/131] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:27 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:28.149700 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:28.150302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:28.157517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.158123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.159081 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.159647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.173260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:28.212466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:28.213392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:28.219948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.220280 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.221116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.221719 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.367510 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.377737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.379277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.380379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c7abcdd6-c8c7-4c34-9432-2489e6c583b8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.234597 Aug 01 15:15:28.380937 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 69/132] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:28 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:28.385934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:28.386537 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:28.392482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.392926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.393687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.394122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.399045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.406278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e99dfe4c-f3bd-4668-b8b9-1e78b607c302 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.197781 Aug 01 15:15:28.406872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 64/133] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:28 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:28.458178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:28.458809 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:28.465260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.465715 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.466458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.466916 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.551857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.559803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a528ba1b-86a7-4b95-8c00-1eba83966623 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.177870 Aug 01 15:15:28.560362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 70/134] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:28 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:28.613740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.621840 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4b6d926b-c556-4717-a3b8-ab36c21a2cd1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.168718 Aug 01 15:15:28.622402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 65/135] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:28 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:29.404862 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.405502 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.411423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.411866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.412623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.413060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.415756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-513907a6-20ea-4c92-9ab1-10508334cde0 req-535b6ccd-7771-4650-850d-9b1e415d2130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40bc31b-5c78-49e5-99ea-0cc891add3c4", "name": "network-vif-plugged", "status": "completed", "tag": "d51788c4-39dd-4128-bdbc-fb2980d56261"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:29.425760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-513907a6-20ea-4c92-9ab1-10508334cde0 req-535b6ccd-7771-4650-850d-9b1e415d2130 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.426195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-513907a6-20ea-4c92-9ab1-10508334cde0 req-535b6ccd-7771-4650-850d-9b1e415d2130 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.437189 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-513907a6-20ea-4c92-9ab1-10508334cde0 req-535b6ccd-7771-4650-850d-9b1e415d2130 service nova] Creating event network-vif-plugged:d51788c4-39dd-4128-bdbc-fb2980d56261 for instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 on hv-cinder-84327 Aug 01 15:15:29.442213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-513907a6-20ea-4c92-9ab1-10508334cde0 req-535b6ccd-7771-4650-850d-9b1e415d2130 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085383 Aug 01 15:15:29.442831 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 71/136] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:29.448191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.448863 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.455169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.455756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.456350 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.456774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.607235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.616025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.617451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.619121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bab41b5b-161b-46e2-a406-6c79bf666054 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.218281 Aug 01 15:15:29.619691 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 66/137] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:29.624294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.624908 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.630857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.631307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.632067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.632557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.637136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.647415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0dc1db3c-65c6-4005-bb69-10482c2dfb05 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.203359 Aug 01 15:15:29.647999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 72/138] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:29.653039 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.653971 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.661630 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.662070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.662875 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.663286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.840338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.845007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.849380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4279dfed-ae08-488a-b6c4-92a55f3243c6 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.227321 Aug 01 15:15:29.849380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 67/139] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:29.867371 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e483a0cd-6767-4b4e-8e8d-dc5e37dfb8f1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.218036 Aug 01 15:15:29.868423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 73/140] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:30.642389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.643163 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.650589 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.651065 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.651975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.652480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.669839 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.670431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:30.678334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.678811 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.679565 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.679993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.859853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.865547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.868464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.870131 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.871371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2b8312d5-482f-4a9e-9de1-4cff5d0b59f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.233279 Aug 01 15:15:30.871856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 68/141] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:30.877730 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e7e86558-3f12-47aa-a566-db11b832a064 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.211559 Aug 01 15:15:30.878329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 74/142] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:30.879604 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.880279 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.887274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.887792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.888615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.889113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.894746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.898186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.905013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.905472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.906221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.906645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.076704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:31.084521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7398871a-4ea7-4a9f-97ce-cfcdd4923fbf tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.209263 Aug 01 15:15:31.085087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 69/143] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:31.097999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:31.105830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-77337077-fc88-45bc-8f0b-0cc84b675276 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.220447 Aug 01 15:15:31.106406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 75/144] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:31.894760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:31.895377 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:31.898516 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:31.899672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:31.902091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.902543 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.903331 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.903757 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.906529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.907083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.907844 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.908279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.281347 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.289069 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.290175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.291738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.292851 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1e0cf2b1-7e0d-46c0-8d5c-490c12ee60d0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.402313 Aug 01 15:15:32.293422 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 70/145] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:31 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:32.297297 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-510ca69e-70f0-403e-8720-67a4b1c73248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.403260 Aug 01 15:15:32.297813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:32.298114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 76/146] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:31 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:32.298479 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:32.308485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:32.309358 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:32.309828 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:32.310428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.311372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:32.311966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.316267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:32.316703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.317467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:32.317892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.506519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.514385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1570a6e2-9502-44d9-b5e6-9400a5b0632b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.219993 Aug 01 15:15:32.514996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 71/147] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:32 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:32.518155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.526219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bb818cc8-794e-4fd9-9100-16bd48e6a6ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.226919 Aug 01 15:15:32.526791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 77/148] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:32 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:33.319057 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:33.319711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:33.320076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.320168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.325733 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.326044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.326194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.326507 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.326982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.327289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.327418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.327725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.528195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.532616 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.541646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-69935335-e7b9-4c51-907d-a4731b3b6e31 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.223086 Aug 01 15:15:33.541646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 78/149] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:33 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:33.541880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.543505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.544679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e167db31-b59c-44fc-b357-d12f1eee403f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.229728 Aug 01 15:15:33.545513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 72/150] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:33 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:33.549765 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:33.550355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.556562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.557016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.557902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:33.558404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.559285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.559766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.566136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.566572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.567353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.567800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.762331 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.765332 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.771982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5454d8fd-d35d-442b-8f77-df34f3d24575 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.225405 Aug 01 15:15:33.772568 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 73/151] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:33 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:33.774757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6fb322cc-861d-43e0-94ce-1c63e6463b60 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.233263 Aug 01 15:15:33.774757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 79/152] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:33 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:34.560135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.560758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.566900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.567366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.567499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.567599 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.568316 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.568748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.573645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.574079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.574924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.575352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.758695 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.765563 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.766391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de97719f-1e0c-4867-88b5-ba4bcf4acdc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.210036 Aug 01 15:15:34.766997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 74/153] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:34.773690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.775199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.776288 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-65aa5c4e-3325-4a86-9ca9-f8346b1d239d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.213525 Aug 01 15:15:34.777009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 80/154] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:34.794474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.795106 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.795369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.795963 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.801530 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.801707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.801964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.802144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.802735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.802934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.803196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.803362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.007329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:35.014069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:35.016905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-63fb2dea-d80f-4c24-be52-32d6335b7472 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.224871 Aug 01 15:15:35.017487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 81/155] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:35.021692 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ee7db22a-14dc-4892-b24f-870653f1abab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.231050 Aug 01 15:15:35.022385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 75/156] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:35.788524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:35.789186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:35.795687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.796126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.796866 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.797293 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.806390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:35.807149 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:35.813400 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.813937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.814805 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.815314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.990560 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:35.998858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5dbce874-b3a7-4835-aac7-f377f7ecef0b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.214044 Aug 01 15:15:35.999832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 82/157] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:35 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:36.001996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.010733 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.012482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.013716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-51476060-eb84-4458-89cd-d149bee12031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.211801 Aug 01 15:15:36.014266 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 76/158] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:35 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:36.038953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:36.040209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:36.042170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=99 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:36.045045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:36.045779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:36.051503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.052779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.053293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.054613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.056116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.057163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.058449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.059119 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.264468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.271534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.272145 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-60386f83-d3c5-44a5-969a-d73082cee6de tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.232678 Aug 01 15:15:36.272732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 77/159] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:36 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:36.280208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8354c891-ab9e-49ea-ab67-292836386ebb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.245384 Aug 01 15:15:36.281019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 83/160] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:36 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:37.019616 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:37.020207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:37.022095 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=95 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:37.028582 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.029033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.029806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.030241 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.041452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:37.042052 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:37.048381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.048959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.049841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.050277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.275473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.277648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.283463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5cd0a4f4-2405-4a66-b6e5-ebd66d6a7013 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.267719 Aug 01 15:15:37.284342 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 78/161] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:37 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:37.287553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.289679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.290960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0c77ce5e-7b24-4bf5-a0ca-c57420301dec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.253526 Aug 01 15:15:37.292032 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 84/162] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:37 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:37.294715 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:37.296364 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:37.305697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:37.306404 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:37.307055 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.307676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.309096 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.309792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.314042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.314567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.315257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:37.317149 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.317840 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.519583 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.524033 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.527867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8602c380-6cc5-4fa7-ba80-5e362b6e0218 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.238327 Aug 01 15:15:37.528550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 79/163] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:37 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:37.531796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9f10bd92-cc28-4712-acbd-56f70a637e66 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.231677 Aug 01 15:15:37.532364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 85/164] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:37 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:38.318063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:38.318754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:38.324475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:38.325090 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:38.326121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.326573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.327433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.327874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.332047 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.333959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.333959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.333959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.353981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:38.533237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.538681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.545723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.548097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.549194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a1eb2304-3ba6-450f-9765-b6a1fd620731 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.235371 Aug 01 15:15:38.550161 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 80/165] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:38 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:38.551940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c7787afb-aa1b-4f64-86ab-177668590310 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.232099 Aug 01 15:15:38.552717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 86/166] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:38 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:38.555141 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:38.555749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:38.557973 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:38.558909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:38.562390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.563147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.564018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.564568 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.569506 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.569952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.571294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.571727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.770865 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.778888 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.779354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5b105d8f-02eb-4c07-b762-a58b58dc2d42 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.227998 Aug 01 15:15:38.785121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 81/167] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:38 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:38.787637 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b05ba1fe-7052-4029-8e17-9a2efe13047c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.233619 Aug 01 15:15:38.788406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 87/168] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:38 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:39.572077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.572609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.572985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.573782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.579381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.579832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.580274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.580587 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.580730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.581294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.581475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.582138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.790368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.791636 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.800631 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ad0fd95e-1e3f-4cf1-95eb-7f210eb6cb77 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.231923 Aug 01 15:15:39.801324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 88/169] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:39.801647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.803376 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.804383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0add5c3d-f40a-4197-8254-8369f96d6a19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.236485 Aug 01 15:15:39.804974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 82/170] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:39.807413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.808014 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.810097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.811003 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.814533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.815011 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.815780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.816209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.818040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.818490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.819282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.819716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.013936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:40.017152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:40.022079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-004fd3ef-0383-405f-be64-b74098d4edc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.219892 Aug 01 15:15:40.022773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 89/171] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:40.025159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-703e8fc0-56df-468e-8b13-599dd794f705 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.218984 Aug 01 15:15:40.025722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 83/172] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:40.823548 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:40.824154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:40.827133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:40.827747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:40.833101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.833530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.834064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.834296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.834511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.834800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.835618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.837666 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.028050 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.031197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.036146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e60d1862-f6f8-4976-b0cc-4a3e755613ff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.217381 Aug 01 15:15:41.036719 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 90/173] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:40 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:41.040496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.042054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.043203 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-20ae48bc-74d9-4e88-9d15-f3be00a901de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.220181 Aug 01 15:15:41.043751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 84/174] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:40 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:41.044923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:41.045552 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:41.048206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:41.055154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:41.055322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.055440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.055546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.055646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.056339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.056444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.056774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.056892 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.252590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.260607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-807328fb-28a2-4427-ad08-7870983cc2c8 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.215896 Aug 01 15:15:41.261176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 85/175] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:41 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:41.264389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.272308 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ba2d0deb-87fe-4d6b-a2fc-edf706de015b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.233103 Aug 01 15:15:41.274447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 91/176] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:41 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:42.063928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:42.064697 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:42.064857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:42.065421 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:42.070857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.071308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.071505 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.071955 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.072108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.072483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.072706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.073138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.278334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.281375 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.286783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.288201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.289102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bcf66d7c-8ff1-40e1-9681-48b6f8ab9bff tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.229279 Aug 01 15:15:42.289896 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c5f98e7f-1bf4-4915-9d0b-afcd4016fb9f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.228559 Aug 01 15:15:42.290239 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 86/177] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:42 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:42.297685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 92/178] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:42 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:42.297857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:42.297857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:42.298015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:42.298015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:42.301332 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.301745 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.302466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.303373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.303532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.303825 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.304581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.305572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.501907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.505325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.509658 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9a3c3624-9b39-4ebc-8ae2-d205da2d9842 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.218409 Aug 01 15:15:42.510237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 87/179] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:42 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:42.513054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-045eebd5-5371-4915-9a0a-2e38ce3a90d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.221072 Aug 01 15:15:42.513693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 93/180] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:42 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:43.318647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:43.319962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:43.320094 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:43.321612 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:43.327924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.328493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.329509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.330151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.330921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.331357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.332556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.333596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.555598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.558628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.573556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c157bbf9-bef3-4a13-8c39-813150610a88 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.255816 Aug 01 15:15:43.573556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 88/181] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:43 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:43.573556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-98ad6d8e-3a75-4f9b-8218-d8c9a762104c req-54ff4674-ced3-42e0-bb22-404eb91a195e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f6aeb2-92b5-4698-a380-4267e8765034", "name": "network-vif-plugged", "status": "completed", "tag": "0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:43.583237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.584749 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.585026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-98ad6d8e-3a75-4f9b-8218-d8c9a762104c req-54ff4674-ced3-42e0-bb22-404eb91a195e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.585548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-98ad6d8e-3a75-4f9b-8218-d8c9a762104c req-54ff4674-ced3-42e0-bb22-404eb91a195e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.585857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-62914504-8b5d-4b9f-a86d-7ff75d4449b3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.276515 Aug 01 15:15:43.587289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 94/182] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:43 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:43.591905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:43.592693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:43.598778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.599423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.600341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.600933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.602436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-98ad6d8e-3a75-4f9b-8218-d8c9a762104c req-54ff4674-ced3-42e0-bb22-404eb91a195e service nova] Creating event network-vif-plugged:0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca for instance 41f6aeb2-92b5-4698-a380-4267e8765034 on hv-cinder-84327 Aug 01 15:15:43.609062 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-98ad6d8e-3a75-4f9b-8218-d8c9a762104c req-54ff4674-ced3-42e0-bb22-404eb91a195e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041723 Aug 01 15:15:43.610004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 89/183] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:43.616394 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:43.617151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:43.626038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.626491 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.627293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.627745 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.809487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.817858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-64b5217a-52cd-4b03-a54a-d3dba4a52418 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.229410 Aug 01 15:15:43.818432 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 95/184] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:43 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:43.822338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.831371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9990e00b-af0f-44b5-90b0-3464e3570a3d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.219092 Aug 01 15:15:43.831627 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 90/185] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:43 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:44.589770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:44.590516 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:44.596621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.597066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.597812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.598340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.609509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:44.610028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:44.616142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.616587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.617385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.617814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.808412 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.815156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.815892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2f398d56-bcb6-4d4c-885b-d9b3ebb765a7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.230498 Aug 01 15:15:44.816739 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 96/186] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:44 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:44.823047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.824527 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.825605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ffbc772b-8b06-45e2-b8f9-84d5d0cf55d4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.220067 Aug 01 15:15:44.826170 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 91/187] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:44 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:44.842968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:44.843565 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:44.849662 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.850096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.850871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.851242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:44.851358 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.852413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:44.858233 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.858686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.859448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.859874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.053003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:45.061894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-287569f9-4964-4c11-bced-0deedbdec1d3 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.222628 Aug 01 15:15:45.062783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 97/188] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:44 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:45.067070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:45.077130 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-291246c9-c068-4b26-bb4c-b6905ce090e7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.229480 Aug 01 15:15:45.077696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 92/189] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:44 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:45.837387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:45.837894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:45.843959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.844395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.845138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.845560 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.851586 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:45.852691 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:45.858769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.859217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.859973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.860410 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.193716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.201450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-80499bfb-b114-4066-88c9-f55e0c255b86 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.368450 Aug 01 15:15:46.202031 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 98/190] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:45 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:46.206522 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:46.208129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:46.213910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:46.214647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.215684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:46.216317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.228152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.236144 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.238152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.239280 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-510175e8-01a2-4fed-ad8e-083d6b21a803 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.391838 Aug 01 15:15:46.239857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 93/191] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:45 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:46.244197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:46.244795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:46.250952 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:46.251403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.252166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:46.252599 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.403776 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.411378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ca97960b-a201-4ae2-9ba8-8d0737b29f9d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.208391 Aug 01 15:15:46.412034 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 99/192] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:46 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:46.424821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.432480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1c5af31-2fa7-4171-b6c4-0148b3b2fc30 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.191398 Aug 01 15:15:46.433039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 94/193] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:46 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:47.227259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:47.227810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:47.233830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.234267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.235038 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.235465 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.262129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:47.263032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:47.268942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.269462 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.270213 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.270647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.418754 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.426185 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bff7e6f0-d428-4f84-b654-16c0796ddf07 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.203343 Aug 01 15:15:47.426927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 100/194] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:47 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:47.433167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:47.433878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:47.440407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.440847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.441601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.442028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.445992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.454302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.455828 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.457187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3a7b7613-f729-4c33-82fd-2d9f210537ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.199466 Aug 01 15:15:47.457905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 95/195] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:47 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:47.462686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:47.463275 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:47.469138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.469589 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.470514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.470971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.489045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:47.637781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.644800 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.645444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c3db24ca-45aa-49b6-8283-853ed48cb14d tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.216022 Aug 01 15:15:47.646016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 101/196] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:47 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:47.652199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de0e367b-8993-49d6-b4af-e978e96ce59a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.193513 Aug 01 15:15:47.652761 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 96/197] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:47 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:48.447479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.448076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:48.454039 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.454480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.455264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.455701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.480767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.481367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:48.487748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.488194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.488950 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.489378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.650830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.657748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.658531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a5903fe4-a1a5-4fbc-8cd7-1276220583e6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.215600 Aug 01 15:15:48.659139 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 102/198] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:48.665604 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.666194 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:48.668362 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.669866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.671190 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a5dd1ec3-6486-40d8-8935-91a74eab9362 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.194256 Aug 01 15:15:48.671740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 97/199] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:48.672268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.672706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.673455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.673991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.677221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.677815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:48.679421 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:48.684185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.684628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.685379 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.685806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.876372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.879596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.884665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-097854ac-9c64-47a1-9955-1f4bb42125e7 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.223091 Aug 01 15:15:48.885230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 103/200] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:48.887673 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1fb442f9-dd75-4536-8874-f64e7764250a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.214594 Aug 01 15:15:48.888311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 98/201] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:49.685140 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:49.685744 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:49.691857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.692309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.693073 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.693324 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:49.693750 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.693925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:49.699936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.700374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.701115 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.701541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.881965 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:49.895176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:49.896842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:49.897920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:49.898057 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bd2b53be-05af-4d81-a98b-13cf57f8e293 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.208589 Aug 01 15:15:49.898801 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 99/202] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:49 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:49.905635 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:49.905803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a8931900-b605-457a-9653-d2e9a29d4927 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.224424 Aug 01 15:15:49.906573 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 104/203] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:49 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:49.906713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:49.912570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.913087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.913917 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.914443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.923272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:49.923871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:49.930224 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.930687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.931443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.931872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:50.097495 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:50.104840 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-30f9a089-7fb4-49c8-99a0-85daac6f6920 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.202854 Aug 01 15:15:50.105401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 100/204] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:49 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:50.125274 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:50.133277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b608c633-b7b2-4870-a927-33416d9239c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.213148 Aug 01 15:15:50.133843 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 105/205] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:49 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:50.922492 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:50.923207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:50.927183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:50.929082 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:50.930266 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:50.930974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:50.932082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:50.932818 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:50.938166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:50.938822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:50.940592 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:50.945158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.165797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.166710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.181061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.182571 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.187026 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-24acd9b8-d672-48cd-899b-40025d39f8b9 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.264755 Aug 01 15:15:51.197456 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-480fec59-c777-45f1-980a-ddf0c90e2000 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.271690 Aug 01 15:15:51.203342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 106/206] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:50 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:51.209555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 101/207] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:50 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:51.215151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:51.215795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:51.219330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:51.219822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:51.227959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.228402 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.229162 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.229590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.236345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.236810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.237580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.238612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.737020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.753881 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c22ae53c-f421-44bb-b74f-58fec2aa4b7b tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.549524 Aug 01 15:15:51.754627 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 107/208] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:51 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:51.814251 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.832813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0daef25b-3e99-4992-8a56-d103895ead59 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.622060 Aug 01 15:15:51.833764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 102/209] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:51 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:52.209148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:52.209762 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:52.217010 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:52.218368 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:52.226090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.230927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.231636 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.232099 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.235271 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.235785 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.236618 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.237064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.792699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:52.797066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:52.801428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:52.803063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:52.804159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5aa3e2b0-4185-49af-b787-14c0d8c585f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.591078 Aug 01 15:15:52.804715 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-36031c27-157c-4fdb-9cf4-ee9fcf9ee803 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.599776 Aug 01 15:15:52.804830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 103/210] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:52 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:52.805468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 108/211] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:52 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:52.809179 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:52.809771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:52.815887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.816328 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.817261 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.817688 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.859646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:52.860352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:52.866505 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.867617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.868397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.868832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.001711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:53.013721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3203d179-c27d-4e6d-a6dc-8ed140e9a3fb tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.207895 Aug 01 15:15:53.014693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 104/212] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:52 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:53.039509 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:53.048202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2ccb94b0-ef3c-4a61-9873-7949f09983dd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.192331 Aug 01 15:15:53.048783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 109/213] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:52 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:53.825640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:53.826301 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:53.831271 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:53.832076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:53.832743 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.833199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.833964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.834396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.838017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.838461 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.839258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.839691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.070293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.075168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.078324 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-585a74a5-f3ac-4813-9ab1-5c851b33f7be tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.256590 Aug 01 15:15:54.078857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 105/214] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:53 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:54.083496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-06e5cbfd-9bcf-4a8c-8edc-fa166eff7f97 req-e804633b-5421-4471-a5e4-ad7b5dee0288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf0433e-acd3-4be5-9bd6-af6c2851084b", "name": "network-vif-plugged", "status": "completed", "tag": "fed91c7f-477d-4a1c-a51a-755932302fbd"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:54.089697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.091460 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.092688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9eb9f03e-38d3-4d24-b6ee-0d14650a58b6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.265412 Aug 01 15:15:54.093694 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 110/215] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:53 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:54.098317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:54.098954 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:54.100082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06e5cbfd-9bcf-4a8c-8edc-fa166eff7f97 req-e804633b-5421-4471-a5e4-ad7b5dee0288 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.100526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06e5cbfd-9bcf-4a8c-8edc-fa166eff7f97 req-e804633b-5421-4471-a5e4-ad7b5dee0288 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.106270 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.106789 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.107561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.108003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.113938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-06e5cbfd-9bcf-4a8c-8edc-fa166eff7f97 req-e804633b-5421-4471-a5e4-ad7b5dee0288 service nova] Creating event network-vif-plugged:fed91c7f-477d-4a1c-a51a-755932302fbd for instance bbf0433e-acd3-4be5-9bd6-af6c2851084b on hv-cinder-84327 Aug 01 15:15:54.119396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-06e5cbfd-9bcf-4a8c-8edc-fa166eff7f97 req-e804633b-5421-4471-a5e4-ad7b5dee0288 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039400 Aug 01 15:15:54.123873 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 106/216] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:54.129480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:54.130187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:54.137111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.137568 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.138340 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.139171 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.319198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.326152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.337707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0dc13bff-baa6-4b7a-91d6-6cff131a333f tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.242696 Aug 01 15:15:54.338862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 111/217] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:54 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:54.350451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-570aa9d1-c440-4b93-8031-3a72cde9f36f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.215090 Aug 01 15:15:54.350451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 107/218] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:54 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:55.103570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.105379 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.116244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.116700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.117334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.117872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.118016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.118405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.125003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.125727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.126875 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.127481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.326443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.330289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.334539 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa693654-d82e-41c3-b917-fc98d8aaa763 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.235318 Aug 01 15:15:55.335175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 108/219] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:55.338873 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.340523 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.341608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c19c9168-9a77-4d32-99fe-071e8a93e350 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.229153 Aug 01 15:15:55.342151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 112/220] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:55.359434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.360041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.360930 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.361529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.366124 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.366573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.367940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.368205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.368374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.368648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.369395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.369822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.562608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.571219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5765979b-1cca-40f7-bea0-a0c5e30ab392 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.213798 Aug 01 15:15:55.572221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 113/221] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:55.580260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.589524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-379b7460-e8c5-4ba1-8f08-37d2936b334e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.233811 Aug 01 15:15:55.590109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 109/222] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:56.356235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:56.356921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:56.364633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.365394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.366607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.367663 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.367787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:56.368535 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:56.377498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.378329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.379829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.380483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.638904 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.639896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.651359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6fceda09-9e30-4751-84d2-361c6b0864fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.299845 Aug 01 15:15:56.652065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 114/223] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:56 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:56.653386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.655835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.657035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-053d20e4-7eab-45ec-8b62-d8c133a52309 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.296535 Aug 01 15:15:56.657510 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:56.657647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 110/224] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:56 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:56.666985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:56.667418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:56.668166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:56.674199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.674898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.675832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.676187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.676747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.676935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.677630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.678055 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.890246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.893875 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.900198 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9b768671-6123-484f-8f0c-3892aebcc31c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1319 microversion: 2.1 time: 0.241343 Aug 01 15:15:56.901199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 111/225] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:56 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:56.902549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f0dff223-6cac-4453-a662-19ac0103f17a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.249432 Aug 01 15:15:56.903210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 115/226] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:56 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:57.674558 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:57.674558 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:57.681298 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.681764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.682710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.683278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.683623 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:57.685169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:57.693979 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.694620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.695524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.696224 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.908359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:57.912019 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:57.918467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:57.920346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:57.921236 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ca0c95f1-c939-4cb0-863d-2fb1d8a85faf tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.252155 Aug 01 15:15:57.921676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-63fa12da-8344-4b2a-a035-547ecc40a7a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.245203 Aug 01 15:15:57.924329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 116/228] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:57 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:57.933803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:57.934763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:57.934874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 112/228] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:57 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:57.939756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:57.940856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:57.942826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.943284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.944056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.944485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.948197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.948803 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.949562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.950154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:58.147159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.151463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.155087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:58.163517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c87e4140-b741-4da3-82da-1142e9d03632 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.227515 Aug 01 15:15:58.176910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 113/229] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:57 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:58.179357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8cf39c13-a4e4-4a80-bfed-1857d188b565 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1506 microversion: 2.1 time: 0.251417 Aug 01 15:15:58.179933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 117/230] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:57 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:58.944586 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:58.946245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:58.946873 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:58.947003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:58.952862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:58.953001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:58.953309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:58.953914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:58.954055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:58.954650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:58.954883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:58.955389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:59.155811 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:59.161693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:59.164247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:59.165767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:59.166841 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93782fe4-0f41-4861-b528-5c1867fed08b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.226629 Aug 01 15:15:59.167570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 114/231] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:15:58 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:59.169918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1da2c4ed-91ef-40d0-8a3a-9f5a28e7741e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.228242 Aug 01 15:15:59.170705 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 118/232] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:58 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:59.188209 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:59.188808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:59.196446 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:59.197182 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:59.198130 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:59.198562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:59.333170 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:59.341421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d96839e2-31d4-46d0-ba44-a9a5d4cc9d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.157097 Aug 01 15:15:59.341995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 115/233] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:15:59 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:00.190581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:00.190581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:00.195641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:00.196267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:00.198579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.199120 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.199953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.200598 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.203774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.204226 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.204998 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.205464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.403481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.407655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:00.409198 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.415877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.417380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9e116bb9-c069-4026-bb59-ba9364a5d108 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.225724 Aug 01 15:16:00.417508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.417958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 116/234] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:00 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:00.418498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1f4ab5bd-a9cb-4a3e-9d51-147ad38910d3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.233024 Aug 01 15:16:00.419459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 119/235] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:00 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:00.435351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:00.435967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:00.443155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.443532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.444306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.445338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.584370 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.592834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58d7fdf5-79bd-43e8-8509-db4360628374 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.173886 Aug 01 15:16:00.593649 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 117/236] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:00 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:01.438118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:01.439050 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:01.444097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:01.445793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:01.445914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.446366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.447170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.447786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.453358 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.454060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.455330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.455775 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.655605 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:01.663580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-75b8b1a1-5a13-4696-819e-d6a336be22b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.229241 Aug 01 15:16:01.664411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 120/237] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:01 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:01.677236 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:01.677236 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:01.677576 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:01.678188 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c43a469b-2c45-4aef-ad6b-5f18f38d45d6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.237995 Aug 01 15:16:01.684467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:01.685220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:01.691713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.692168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.692972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.693562 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.693797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 118/238] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:01 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:01.848423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:01.857062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b7136695-a2df-4d7e-8b9e-5aebb1347a2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.177608 Aug 01 15:16:01.857870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 121/239] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:01 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:02.685122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:02.686079 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:02.693382 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.693896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.695232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.695834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.700693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:02.701302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:02.707890 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.708325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.709428 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.709863 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.895994 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.900952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.908310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c3e4f3bb-2c18-4014-856c-c57e79bd2b83 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.227540 Aug 01 15:16:02.914937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 119/240] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:02 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:02.914937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:02.914937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:02.920727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.921429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.921727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.922499 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.922864 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.922993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.924366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4b02039d-bec5-4375-aa66-943e79fb25bf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.227488 Aug 01 15:16:02.925129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 122/241] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:02 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:03.056106 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:03.063469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c9ab40b7-8397-4619-8830-3c4664c34d06 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1326 microversion: 2.1 time: 0.153175 Aug 01 15:16:03.064032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 120/242] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:02 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:03.929283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:03.929885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:03.936484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.936930 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.937715 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.938152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.950776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:03.951506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:03.961862 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.962703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.963658 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.964205 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.149237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.159787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-237819fe-4ebf-40e0-9095-30332786ce6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.234381 Aug 01 15:16:04.170527 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 123/243] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:03 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:04.170527 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:04.170527 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:04.175336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.175608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.175608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.176494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.177206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.182604 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.184156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.185260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4babe6f1-715f-4c58-b314-76c856dd2ffb tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.241487 Aug 01 15:16:04.185808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 121/244] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:03 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:04.317018 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.325247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9538f6f2-36c1-4793-9b91-5fa84de9f487 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1521 microversion: 2.1 time: 0.163630 Aug 01 15:16:04.325891 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 124/245] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:04 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:04.347877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:04.350136 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:04.357433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.357937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.358719 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.359147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.421876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lazy-loading 'flavor' on Instance uuid bbf0433e-acd3-4be5-9bd6-af6c2851084b {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:16:04.536730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93dd5715-78c3-463b-afcb-f8ba0032b0c3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b/action" status: 200 len: 32 microversion: 2.1 time: 0.192578 Aug 01 15:16:04.537504 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 122/246] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:16:04 2022] POST /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:16:04.546802 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:04.547408 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:04.553492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.553936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.554707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.555138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.682625 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.690068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-555e67e1-0aa9-4f07-af12-9ea0d04c44d7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.147158 Aug 01 15:16:04.690631 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 125/247] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:04 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:05.052091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bb8c3af-c97d-4aab-b065-b15362a6bfa9"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:05.055570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:05.063121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.063564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.064328 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.064764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.116020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-843837895", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "networks": [{"uuid": "c6df9827-474b-4293-bcd0-255140971e16"}]}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:05.186894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] validate_networks() for [('c6df9827-474b-4293-bcd0-255140971e16', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:16:05.727442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:16:05.727857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:16:05.728323 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:16:05.728762 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:16:05.729162 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:16:05.738067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.738509 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.739335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.739798 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.757597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Getting quotas for project 060a7c219492407581c39806cc5726a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:16:05.761742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Getting quotas for user b507df75a6564522bf6746587d081a03 and project 060a7c219492407581c39806cc5726a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:16:05.772961 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:16:05.775244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:16:05.795253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:05.824744 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bca25750-ff82-4458-8ec1-840220811406 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.712723 Aug 01 15:16:05.825380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 126/248] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:16:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 01 15:16:05.832016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:05.832628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:05.838977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.839395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.840240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.840676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.989731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:05.999353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7855761a-beda-481c-b9c5-7255a872c40c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.171622 Aug 01 15:16:06.000133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 127/249] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:05 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:06.006458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:06.007320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:06.013667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.014343 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.015322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.015745 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.176489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.189918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.193331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.194531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9118da93-d7fd-4aa6-a87a-1578860756c8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.192923 Aug 01 15:16:06.195122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 128/250] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:06 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:06.203643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:06.206260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:06.214156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.214645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.215397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.215833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.402866 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.417729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6689aad2-1a7d-4d67-b668-9f321c324b21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.221098 Aug 01 15:16:06.428442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 129/251] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:06 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:06.428442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:06.428442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:06.431810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.432251 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.433029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.433438 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.501521 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.509369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3fd2d345-1e60-4d21-9a6f-e4b80a853226 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1226 microversion: 2.1 time: 0.089048 Aug 01 15:16:06.509929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 130/252] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:06 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:07.021255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:07.022182 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:07.030320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.030968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.031912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.032518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.181633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.189960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e48e9836-3b8d-43fa-a10e-cd458c819d91 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.172869 Aug 01 15:16:07.190551 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 131/253] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:07 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:07.218197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:07.218832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:07.225212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.226174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.227166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.227602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.360330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.369220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.370829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.371932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b77beea8-be25-413b-8f37-fbaf1c6acf4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.158381 Aug 01 15:16:07.372493 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 132/254] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:07 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:07.440809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:07.441395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:07.448738 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.449174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.449913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.450338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.594061 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.601442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-364ac495-cd0b-4dde-b49e-4b4b79ac8ae6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.164508 Aug 01 15:16:07.602009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 133/255] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:07 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:07.606362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:07.606978 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:07.613197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.613638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.614441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.614905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.678508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.689308 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-41ffedf8-1e36-48ad-b133-10b9a53328da tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1226 microversion: 2.1 time: 0.085564 Aug 01 15:16:07.690087 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 134/256] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:07 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:08.229091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:08.234213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:08.279588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.284084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.293531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.294588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.331827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-517df020-fe69-4e7a-bc75-9948c7d02f7e tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "POST /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.285671 Aug 01 15:16:08.338825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 123/257] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:16:05 2022] POST /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034/os-volume_attachments => generated 194 bytes in 3288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:08.394206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:08.394942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:08.397211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=92 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:08.419038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.419688 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.420792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.421383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.625951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.636487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9b09d5ce-82ea-4bc0-8a31-17c7b75b614f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.427075 Aug 01 15:16:08.637083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 135/258] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:08 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:08.648793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:08.649421 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:08.657172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.657615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.658376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.658828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.756408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.765910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.767441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.768550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3b67a1da-451b-474e-86df-9a9c218483ed tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.378923 Aug 01 15:16:08.769096 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 124/259] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:08 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:08.790046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:08.790655 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:08.797834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.798497 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.799469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.799902 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.892326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.907300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3c1cec2-3436-492a-b0a6-6c0827c8ccaa tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1274 microversion: 2.1 time: 0.123279 Aug 01 15:16:08.908627 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 125/260] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:08 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:08.918368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.929878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-996ba147-1a63-4a5a-bcce-c433467ed159 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.288852 Aug 01 15:16:08.944723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 136/261] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:08 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:09.659680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:09.661109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:09.670095 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.671392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.672433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.672966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.796292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:09.796820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:09.810095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.810787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.811660 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.812356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.816986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:09.974129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:09.982435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e60c9443-fe3e-4402-946b-c3073b6b8248 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.326731 Aug 01 15:16:09.983346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 126/262] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:09 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:09.995137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:09.995949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:10.007420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.007879 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.011488 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.012221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.019703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:10.118526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.157058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.163389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.164918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9b683a78-cf4f-4e9d-b0ac-87e45f23d4ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.375546 Aug 01 15:16:10.166832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 137/263] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:09 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:10.174702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:10.175622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:10.186273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.186759 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.190654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.190654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.471243 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.480068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea6b116c-4fe9-4764-b0dc-2015637a5919 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.495371 Aug 01 15:16:10.495516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 127/264] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:09 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:10.514655 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-0912c4c8-7709-4d0d-859d-80cc64592f1a req-b4b1e3ca-e235-436e-a892-2f25453a879c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50052019-4694-4875-8915-9392814a8aba", "name": "network-vif-plugged", "status": "completed", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:10.541985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.553224 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-0912c4c8-7709-4d0d-859d-80cc64592f1a req-b4b1e3ca-e235-436e-a892-2f25453a879c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.553814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-0912c4c8-7709-4d0d-859d-80cc64592f1a req-b4b1e3ca-e235-436e-a892-2f25453a879c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.556788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2904afd7-e7db-4cea-9b6a-c5a6ad948982 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.387574 Aug 01 15:16:10.557062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 138/265] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:10 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:10.584233 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-0912c4c8-7709-4d0d-859d-80cc64592f1a req-b4b1e3ca-e235-436e-a892-2f25453a879c service nova] Creating event network-vif-plugged:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:16:10.595230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-0912c4c8-7709-4d0d-859d-80cc64592f1a req-b4b1e3ca-e235-436e-a892-2f25453a879c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085938 Aug 01 15:16:10.595827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 128/266] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:11.007473 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:11.009648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:11.020693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.022926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.023712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.024140 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.191074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:11.191940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:11.199786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.200175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.201894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.202605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.245983 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.264071 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2655692e-23d2-42f1-81b7-8abd737d5cc6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.262444 Aug 01 15:16:11.265191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 139/267] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:10 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:11.394474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.403612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.405470 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.406889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-905da594-9de1-4cf3-95e6-590aa237f9f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.220809 Aug 01 15:16:11.407974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 129/268] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:11 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:11.503036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:11.503728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:11.515246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.515685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.516462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.516857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.580049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:11.580672 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:11.587932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.588384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.589195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.589834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.733491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.741846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d1b7977d-8b45-4e07-b86e-bb04ae7fbe7d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.242035 Aug 01 15:16:11.742819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 140/269] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:11 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:11.766540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.777248 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02794d93-cacb-4a49-8eea-c47ad45746bf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.202533 Aug 01 15:16:11.778234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 130/270] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:11 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:12.292498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:12.293430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:12.304830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.305682 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.306857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.308381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.433252 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:12.434187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:12.453458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.453622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.454355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.454822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.649030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:12.658198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d9ed5616-92b0-454d-9b42-5ee2723a0c2a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.372182 Aug 01 15:16:12.671616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 141/271] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:12.766204 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:12.767279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:12.775185 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.775884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.777013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.778155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.872140 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:12.882685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:12.884318 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:12.886433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f20c0b2d-39ba-41cd-8caa-27451e2f91da tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.460431 Aug 01 15:16:12.887040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 131/272] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:12.891838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1335054045", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "networks": [{"uuid": "72291a58-b102-4cc6-8357-f762588ae4bf"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:12.958012 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] validate_networks() for [('72291a58-b102-4cc6-8357-f762588ae4bf', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:16:13.083182 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.103260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-982bf876-58ec-4bc2-8cf7-8aee41c178d8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.342640 Aug 01 15:16:13.105211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 142/273] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:13.133554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.136523 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:13.143912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.145145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.146240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.146936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.490579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.499919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d91caead-7470-4eec-a24c-7a87caa6de99 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.387592 Aug 01 15:16:13.500799 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 143/274] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:13 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:13.684838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.686300 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:13.694824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.695526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.696526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.697131 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.784152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:16:13.785189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:16:13.786744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:16:13.789405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:16:13.790075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:16:13.815700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.816443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.817463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.821750 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.880617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.881767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Getting quotas for project cc38647adf7e41beb5c47c01149972e0. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:16:13.886348 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Getting quotas for user 55bb7887d98f458688cffbccf4a64b53 and project cc38647adf7e41beb5c47c01149972e0. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:16:13.888431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-79604582-f5ee-4758-aafe-ce8559afb7a3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.211205 Aug 01 15:16:13.889016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 144/275] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:13 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:13.893434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-f4ae2b15-ef45-49cb-b76e-386d8f4eb1b3 req-a2f8b53f-efde-46db-a447-104af95936b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f32dc27-1309-4412-a138-b908602573dd", "tag": "da9d9c38-6f41-4e68-8bbf-2bf2d8ed349c"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:13.903488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-f4ae2b15-ef45-49cb-b76e-386d8f4eb1b3 req-a2f8b53f-efde-46db-a447-104af95936b6 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.903927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-f4ae2b15-ef45-49cb-b76e-386d8f4eb1b3 req-a2f8b53f-efde-46db-a447-104af95936b6 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.912303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:16:13.915683 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:16:13.916114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-f4ae2b15-ef45-49cb-b76e-386d8f4eb1b3 req-a2f8b53f-efde-46db-a447-104af95936b6 service nova] Creating event network-changed:da9d9c38-6f41-4e68-8bbf-2bf2d8ed349c for instance 4f32dc27-1309-4412-a138-b908602573dd on hv-cinder-84327 Aug 01 15:16:13.921172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-f4ae2b15-ef45-49cb-b76e-386d8f4eb1b3 req-a2f8b53f-efde-46db-a447-104af95936b6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031019 Aug 01 15:16:13.921768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 145/276] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:13.927367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.928131 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:13.934740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.935183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.935952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.936385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.975925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4a8b6547-56da-4dda-b6bd-69c3455f4e9b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.087670 Aug 01 15:16:13.977022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 132/277] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:16:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:16:13.989811 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4783dcb3-4275-43c0-bc38-58fa311a6228 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.994049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4783dcb3-4275-43c0-bc38-58fa311a6228 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:14.086277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4783dcb3-4275-43c0-bc38-58fa311a6228 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.102377 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4783dcb3-4275-43c0-bc38-58fa311a6228 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1218 microversion: 2.1 time: 0.117663 Aug 01 15:16:14.114769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 133/278] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:13 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:14.126557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:14.127613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:14.133591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.140235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.141381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.142510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.143263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.154991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.158418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.161744 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d0ec2064-51e4-405d-bc83-4248b75dfc4c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1410 microversion: 2.20 time: 0.238305 Aug 01 15:16:14.175427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 146/279] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:13 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1410 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:14.533779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:14.535409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:14.551165 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.551774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.552390 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.552811 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.728092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.750404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-364bba0a-8566-4718-a446-71acafb19d73 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.628116 Aug 01 15:16:14.751490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 134/280] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:14 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:14.757900 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-7ba1fdef-07c5-49b3-812a-1821a978728c req-e5e03c79-48de-4e3b-91f0-ebd524558271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d7106b-88eb-481b-aa10-bbfffc0cd9f0", "name": "network-vif-plugged", "status": "completed", "tag": "afd70030-3dda-4c22-8097-6ed169808ee0"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:14.773406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7ba1fdef-07c5-49b3-812a-1821a978728c req-e5e03c79-48de-4e3b-91f0-ebd524558271 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.775372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7ba1fdef-07c5-49b3-812a-1821a978728c req-e5e03c79-48de-4e3b-91f0-ebd524558271 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.797200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-7ba1fdef-07c5-49b3-812a-1821a978728c req-e5e03c79-48de-4e3b-91f0-ebd524558271 service nova] Creating event network-vif-plugged:afd70030-3dda-4c22-8097-6ed169808ee0 for instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 on hv-cinder-84327 Aug 01 15:16:14.805682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-7ba1fdef-07c5-49b3-812a-1821a978728c req-e5e03c79-48de-4e3b-91f0-ebd524558271 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050806 Aug 01 15:16:14.807050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 135/281] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:14.867898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.877378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2fdd4f29-e6a5-44b4-b46c-e2966a325df2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.352936 Aug 01 15:16:14.878127 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 147/282] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:14 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:14.911072 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:14.912154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:14.920218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.920739 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.921894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.922240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.062994 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.070293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a60acf2c-4e97-4830-ab58-578bdd1767f6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.164435 Aug 01 15:16:15.070985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 136/283] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:14 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:15.136809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:15.137520 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:15.144194 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.144643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.145440 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.145873 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.187136 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:15.187818 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:15.196626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.196626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.197120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.200696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.218805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.230830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2f5aee47-2c51-40c8-866c-9c127afb8248 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1222 microversion: 2.1 time: 0.098232 Aug 01 15:16:15.231407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 148/284] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:15 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:15.446989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.458017 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.459545 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.460876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d18c4a47-1a0f-4e70-80cc-119282fbfc42 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1603 microversion: 2.20 time: 0.277788 Aug 01 15:16:15.461434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 137/285] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:16:15 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1603 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:15.485216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:15.485943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:15.492760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.494035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.495664 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.497104 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.682080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-057aa064-e487-4e28-84bd-fed18ecbb1a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200861 Aug 01 15:16:15.683115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 149/286] 10.222.0.100 () {60 vars in 1321 bytes} [Mon Aug 1 15:16:15 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:15.773030 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:15.773848 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:15.782281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.782767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.783557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.783981 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.896171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:15.897019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:15.902615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:15.903680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:15.912495 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.914253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.915147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:15.915651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:15.940660 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.949329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-57a92f14-fac9-4237-86c3-6478bfc597d5 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.180675 Aug 01 15:16:15.950148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 138/287] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:15 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:16.093339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:16.093938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:16.101449 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.101889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:16.102653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.103103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:16.104747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:16.112645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-03a17fe7-a678-440c-8797-bb64417dc33b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.217382 Aug 01 15:16:16.113147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 150/288] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:15 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:16.252372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:16.252989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:16.253700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:16.259945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.260819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:16.262448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.263168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:16.269330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0bc7cfc4-9936-49ee-9a99-51595140ee3d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.178722 Aug 01 15:16:16.270238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 139/289] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:16 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:16.338346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:16.346354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-42411257-9209-473b-92a1-d0220fb4610f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1270 microversion: 2.1 time: 0.098243 Aug 01 15:16:16.347053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 151/290] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:16 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:16.972805 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:16.973698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:16.980907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.981430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:16.982274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.982819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.135202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:17.135812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:17.140522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.142619 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.143104 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.144220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.144333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.148344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-84cbd62f-5bea-4e6b-9a00-d17706dacbf2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.179552 Aug 01 15:16:17.149177 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 140/291] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:16 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:17.231458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-553d0109-65fe-4f87-9e03-46657c5f9296 req-04f41b5a-019c-453c-a81d-0a147305d3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50052019-4694-4875-8915-9392814a8aba", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:17.241526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-553d0109-65fe-4f87-9e03-46657c5f9296 req-04f41b5a-019c-453c-a81d-0a147305d3fc service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.241964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-553d0109-65fe-4f87-9e03-46657c5f9296 req-04f41b5a-019c-453c-a81d-0a147305d3fc service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.255553 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-553d0109-65fe-4f87-9e03-46657c5f9296 req-04f41b5a-019c-453c-a81d-0a147305d3fc service nova] Creating event network-changed:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:16:17.260652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-553d0109-65fe-4f87-9e03-46657c5f9296 req-04f41b5a-019c-453c-a81d-0a147305d3fc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032696 Aug 01 15:16:17.261626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 141/292] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:16:17.285862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.295167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-02887917-cd13-496a-b5c8-621bf59f4f7c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.163776 Aug 01 15:16:17.296446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 152/293] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:17 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:17.297922 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:17.298625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:17.305642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.306091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.306893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.307337 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.369395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:17.370534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:17.378839 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.379603 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.380716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.381309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.515615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.525785 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-809270e7-59d9-4b5b-a985-025afb55f36f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1278 microversion: 2.1 time: 0.161625 Aug 01 15:16:17.526732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 153/294] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:17 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:17.551220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.559125 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4ceb4f97-b1f8-4645-b08f-d4abfcb4e8a0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.265245 Aug 01 15:16:17.570699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 142/295] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:17 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:18.169708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:18.170314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:18.176495 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.176932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.177884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.178889 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.317213 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:18.317830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:18.325616 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.326077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.326883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.327490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.480708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.484655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:18.489663 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f23f6b03-a9bc-4c57-a14c-31b14ab6f692 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.324083 Aug 01 15:16:18.503226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 154/296] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:18 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:18.547588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.548574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:18.549345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:18.556806 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.557041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0d78c2aa-a045-48ea-bccc-0104d34391da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.244669 Aug 01 15:16:18.557486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 143/297] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:18 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:18.558016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.558996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.559270 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.582041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:18.582765 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:18.590259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.590865 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.591815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.592246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.748509 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.756251 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1c427a7a-d04a-4e54-929e-5fa6347d61d8 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.212574 Aug 01 15:16:18.756822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 155/298] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:18 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:18.777698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.785309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8dbc8496-1eeb-4862-86a5-0c8fddccae7c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1366 microversion: 2.1 time: 0.207862 Aug 01 15:16:18.785870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 144/299] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:18 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:19.519554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:19.523708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:19.534379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.535082 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.536708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.537310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.577786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:19.578476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:19.587569 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.588127 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.589050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.589682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.843393 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:19.852508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fdbc80e0-f411-43e8-ad7e-a1a5303d79ae tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.343901 Aug 01 15:16:19.853705 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 156/300] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:19 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:19.865537 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:19.866977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:19.870015 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:19.874546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.875098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.876217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.876786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.879703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-df28d8ae-55f6-4a56-96f1-7cb6c886dbf3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.305715 Aug 01 15:16:19.880804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 145/301] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:19 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:19.885727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:19.886546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:19.895290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.896001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.897501 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.898127 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.224167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:20.244756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:20.254196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-88a18bfe-9801-481e-98c2-4c75d658d394 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.399106 Aug 01 15:16:20.257086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-92d798b6-efb7-4708-96fd-cd9dc1c0bb8c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1552 microversion: 2.1 time: 0.373506 Aug 01 15:16:20.258403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 157/302] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:19 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:20.258822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 146/303] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:19 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1552 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:20.298931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:20.299883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:20.308715 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.310010 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.310985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.312958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.425913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-0fa2a485-7ffe-426e-8b98-71bab5639d86 req-d9cca4da-fed1-4817-83e7-f27284ce8ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90e2912-4c37-4113-82dd-d3efd79fa4da", "tag": "28ed31c6-23f1-4e75-8661-94191f64aac6"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:20.442011 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0fa2a485-7ffe-426e-8b98-71bab5639d86 req-d9cca4da-fed1-4817-83e7-f27284ce8ca0 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.443094 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0fa2a485-7ffe-426e-8b98-71bab5639d86 req-d9cca4da-fed1-4817-83e7-f27284ce8ca0 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.462412 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-0fa2a485-7ffe-426e-8b98-71bab5639d86 req-d9cca4da-fed1-4817-83e7-f27284ce8ca0 service nova] Creating event network-changed:28ed31c6-23f1-4e75-8661-94191f64aac6 for instance c90e2912-4c37-4113-82dd-d3efd79fa4da on hv-cinder-84327 Aug 01 15:16:20.471135 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-0fa2a485-7ffe-426e-8b98-71bab5639d86 req-d9cca4da-fed1-4817-83e7-f27284ce8ca0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049466 Aug 01 15:16:20.472774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 158/304] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:16:20.480419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:20.552245 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6615effe-23a0-440e-8e8c-61ec4ff4da89 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.257519 Aug 01 15:16:20.552872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 147/305] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:16:20 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:20.874351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:20.876195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:20.883669 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.884376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.886083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.886846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.906418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:20.907508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:20.921038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.922652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.926693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:20.927354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.250857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.262532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-baf801db-5df2-48f6-9c99-097da1fabc4a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.392458 Aug 01 15:16:21.265362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 159/306] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:20 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:21.270108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.281723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-027cee8f-7fd8-48ce-8bfa-999c542d9bf4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.383249 Aug 01 15:16:21.282603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 148/307] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:20 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:21.300093 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:21.300794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:21.308205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.308650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.309407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.310123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.467738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:21.468565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:21.476082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.476959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.477839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.478350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.505483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:16:21.612614 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4fdb0529-d838-40ec-b17a-f46d9e284008 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 204 len: 0 microversion: 2.1 time: 0.148609 Aug 01 15:16:21.613490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 149/308] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:16:21 2022] DELETE /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:16:21.623856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:21.624809 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:21.632074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.632759 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.633684 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.634273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.735151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.743899 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c7f9a34e-2712-427a-a210-6c3b08b3cf52 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.451941 Aug 01 15:16:21.744574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 160/309] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:21 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:21.823585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.833400 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b718b5b9-a72d-4790-876e-3342708e5ef4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.213981 Aug 01 15:16:21.834127 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 150/310] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:21 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:22.224948 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-673d59be-1479-41ed-a645-8dcd522f15d9 req-b824b687-b2ea-459b-b1c4-999bc788589f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d7106b-88eb-481b-aa10-bbfffc0cd9f0", "tag": "afd70030-3dda-4c22-8097-6ed169808ee0"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:22.235321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-673d59be-1479-41ed-a645-8dcd522f15d9 req-b824b687-b2ea-459b-b1c4-999bc788589f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.236036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-673d59be-1479-41ed-a645-8dcd522f15d9 req-b824b687-b2ea-459b-b1c4-999bc788589f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.249803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-673d59be-1479-41ed-a645-8dcd522f15d9 req-b824b687-b2ea-459b-b1c4-999bc788589f service nova] Creating event network-changed:afd70030-3dda-4c22-8097-6ed169808ee0 for instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 on hv-cinder-84327 Aug 01 15:16:22.255195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-673d59be-1479-41ed-a645-8dcd522f15d9 req-b824b687-b2ea-459b-b1c4-999bc788589f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Aug 01 15:16:22.256920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 161/311] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:22.284709 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:22.285634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:22.293378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.294028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.295216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.295856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.307981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:22.308989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:22.317688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.318594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.320505 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.321144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.491746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:22.504498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9c048df8-613e-4d73-8089-cf3eeb14556b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.223945 Aug 01 15:16:22.507022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 151/312] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:22 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:22.550585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:22.560816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c3cda60c-8625-49bb-ab5b-22fe80b69239 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.257720 Aug 01 15:16:22.561684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 162/313] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:22 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:22.764804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:22.765434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:22.771982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.772434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.773201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.773644 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.855342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:22.855841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:22.869154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.869951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.870956 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.871600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.934816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:22.942775 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7a93d0f-265d-4c16-98ad-8c6c3ac6d6e1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.181766 Aug 01 15:16:22.955556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 152/314] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:22 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:23.038121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:23.047773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-59ca92e2-5b60-403b-bcd2-8f20f5628134 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.196339 Aug 01 15:16:23.048923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 163/315] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:22 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:23.527681 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:23.528292 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:23.535811 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:23.536265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:23.537183 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:23.538227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:23.581984 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:23.583307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:23.590305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:23.590784 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:23.591837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:23.592447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:23.728534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:23.746219 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7986a270-0e13-4298-947d-6ead65886d58 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.222723 Aug 01 15:16:23.747102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 153/316] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:23 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:23.772804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:23.780482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-46ff7f3a-8b38-4887-bb4b-bac98e594913 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.203034 Aug 01 15:16:23.781146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 164/317] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:23 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:23.965864 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:23.966498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:23.969006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:23.974650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:23.975125 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:23.975880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:23.976307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.070885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:24.071484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:24.078019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.078531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.079323 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.080007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.091913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=8 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:24.133971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:24.142037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e5ca0ec0-b3ee-47a9-8dfb-edd4003295b7 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.180009 Aug 01 15:16:24.142733 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 154/318] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:23 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:24.221109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:24.229248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-733c0969-4616-449f-836c-fa10990f5c47 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.163690 Aug 01 15:16:24.229814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 165/319] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:24 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:24.769319 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:24.769941 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:24.777434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.777893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.778647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.779105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.804776 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:24.807063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:24.820959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.821396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.822592 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.823048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.971836 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:24.980212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d288746e-de42-44f2-8472-6141f0357e83 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.214642 Aug 01 15:16:24.980786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 155/320] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:24 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:24.999708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:25.007926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-94e00767-0118-4850-8975-b91f3afbe703 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.210693 Aug 01 15:16:25.008479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 166/321] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:24 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:25.165670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:25.165670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:25.171154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:25.171615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:25.172368 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:25.172802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:25.251941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:25.252554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:25.258815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:25.259396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:25.260167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:25.260814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:25.347064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:25.356094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-83f967f3-c98f-4717-83ab-c995b85a7d17 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.196404 Aug 01 15:16:25.370024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 156/322] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:25 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:25.424742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:25.434957 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4fd6bad9-69bf-4031-9329-9f90f887eeb4 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.187172 Aug 01 15:16:25.435532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 167/323] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:25 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:26.004541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:26.005139 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:26.012105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.012546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.013354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.013784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.029089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:26.029771 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:26.035890 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.036334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.037085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.037594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.204052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.212602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3ce1efac-06dc-449e-87e9-1604a6fd2082 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.211827 Aug 01 15:16:26.219125 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 157/324] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:25 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:26.220894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.228399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e58accc7-349f-4770-a006-1662b0e660fb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.203201 Aug 01 15:16:26.228951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 168/325] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:26 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:26.377445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:26.378016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:26.384622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.385070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.385829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.386262 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.460740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:26.461595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:26.470634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.471054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.471808 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:26.472228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.542735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.550707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1eeda572-44cf-4a13-8ab4-59c5c5e0e022 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.177119 Aug 01 15:16:26.551285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 158/326] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:26 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:26.628841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.637383 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2536b9d0-2ba8-4178-ab38-9334fa296ff9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.182630 Aug 01 15:16:26.637950 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 169/327] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:26 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:27.000374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-76e03f1d-d979-45f2-91ef-7ce2299d1e62 req-0385719e-a04c-4110-b3d9-3001cdbf9bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f32dc27-1309-4412-a138-b908602573dd", "name": "network-vif-plugged", "status": "completed", "tag": "da9d9c38-6f41-4e68-8bbf-2bf2d8ed349c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:27.013468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-76e03f1d-d979-45f2-91ef-7ce2299d1e62 req-0385719e-a04c-4110-b3d9-3001cdbf9bb5 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.014090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-76e03f1d-d979-45f2-91ef-7ce2299d1e62 req-0385719e-a04c-4110-b3d9-3001cdbf9bb5 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.030448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-76e03f1d-d979-45f2-91ef-7ce2299d1e62 req-0385719e-a04c-4110-b3d9-3001cdbf9bb5 service nova] Creating event network-vif-plugged:da9d9c38-6f41-4e68-8bbf-2bf2d8ed349c for instance 4f32dc27-1309-4412-a138-b908602573dd on hv-cinder-84327 Aug 01 15:16:27.037151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-76e03f1d-d979-45f2-91ef-7ce2299d1e62 req-0385719e-a04c-4110-b3d9-3001cdbf9bb5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040225 Aug 01 15:16:27.038333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 159/328] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:27.233405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:27.233924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:27.239892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.240850 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.241619 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.242054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.250378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:27.251117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:27.259193 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.259773 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.260551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.260989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.529505 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:27.539867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-01d48942-d022-4a03-9741-b8fefea805bd tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.310264 Aug 01 15:16:27.540835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 170/329] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:27 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:27.546746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:27.555705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eef2c18f-a584-411b-b031-a7431c23a81f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.309692 Aug 01 15:16:27.556278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 160/330] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:27 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:27.573203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:27.573948 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:27.580021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.580563 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.581634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.582123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.659529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:27.660363 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:27.667630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.668126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.669148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.669507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.749286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:27.757014 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d5212b84-32ef-4a91-9af9-b228d98b3b76 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.187588 Aug 01 15:16:27.757720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 171/331] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:27 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:27.819510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:27.829563 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-182aa866-cc6d-4ed1-a1e1-32c731663b81 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.174015 Aug 01 15:16:27.830468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 161/332] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:27 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:28.561399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:28.562000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:28.568039 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.568983 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.569728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.570157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.575990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:28.576605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:28.583464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.583914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.585245 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.585682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.763797 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:28.767280 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:28.770914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:28.772999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4be893d8-edfc-4104-823d-a9035f074f3f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.215431 Aug 01 15:16:28.773575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 172/333] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:28 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:28.778098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:28.778698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:28.780175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ca03ef30-6ca4-4eb0-91b6-82f3033626d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.208067 Aug 01 15:16:28.780837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 162/334] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:28 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:28.784519 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.785026 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.785784 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.786210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.857364 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:28.857981 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:28.860018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:28.865547 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.865995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.866814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:28.867249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.895643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:28.966787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:28.975355 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-84e94981-4147-4b08-bc95-9586a50e38e2 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.200736 Aug 01 15:16:28.977094 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 173/335] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:28 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:29.056353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:29.065285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-25f101b1-8af2-4ff2-8c17-fadb049bbd3c tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.217323 Aug 01 15:16:29.065862 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 163/336] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:28 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:29.794492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:29.794911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:29.801128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:29.801264 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:29.801708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:29.801848 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:29.802330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:29.802827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:29.809372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:29.809817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:29.810582 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:29.811040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:30.005770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.009142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.013702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3d475871-6075-4ace-be17-6023b51e9b31 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.223576 Aug 01 15:16:30.014283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 174/337] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:29 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:30.017088 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-62980055-b9bb-4b4f-bc76-2347c8939526 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.219627 Aug 01 15:16:30.017839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 164/338] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:29 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:30.018934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:30.019528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:30.025485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:30.025933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:30.026724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:30.027159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:30.088455 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:30.088988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:30.095201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:30.095647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:30.096428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:30.096861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:30.194936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.202893 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9ebdbd1a-5a2b-463c-9f8a-85a700719f50 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.187514 Aug 01 15:16:30.203624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 175/339] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:30 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:30.256135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.264506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea573e78-107f-4d61-b053-e3780bd241bc tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.180506 Aug 01 15:16:30.265097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 165/340] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:30 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:31.036705 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:31.037469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:31.038326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:31.038979 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:31.039391 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:31.045579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.046014 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.046510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.046804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.047004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.047233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.047780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.048223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.259275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:31.264029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:31.267924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9b636f2e-3707-4302-a953-597455c95c45 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.235882 Aug 01 15:16:31.268584 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 176/341] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:31 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:31.273075 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:31.273339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6ddda032-c090-46f2-9f39-5fe81cd18e58 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.239050 Aug 01 15:16:31.273824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:31.274232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 166/342] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:31 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:31.279854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.280543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.281489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.282105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.298909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:31.299608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:31.306162 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.306700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.307552 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.308054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.476493 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:31.483810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-699b42f1-9350-4765-ba7a-ecbb3dafee1f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.214200 Aug 01 15:16:31.484594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 177/343] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:31 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:31.487423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:31.496162 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6071bfdb-4ce1-4e56-9f8c-35ebe4515408 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.201693 Aug 01 15:16:31.496725 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 167/344] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:31 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:32.293540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:32.294230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:32.294648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:32.294767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:32.301255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.301457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.301709 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.301823 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.302485 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.302582 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.302967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.303080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.501191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.504334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.510166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-452a5d93-3043-48d9-95af-8ba3cee446b5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.220473 Aug 01 15:16:32.512338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 178/345] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:32 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:32.512646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bcb95927-e27c-4949-87ba-46cefb098edf tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.222898 Aug 01 15:16:32.513622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 168/346] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:32 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:32.516809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:32.517717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:32.518091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:32.518795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:32.525132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.525583 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.526351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.526810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.532046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.532810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.534207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:32.534692 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.727931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.731936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.736386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d413551f-547a-42b5-a280-cdec1cbe2bea tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1558 microversion: 2.1 time: 0.221758 Aug 01 15:16:32.736967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 169/347] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:32 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:32.739682 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f6e38ed0-fb0e-41df-b20a-39aa4cf09bd1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.227454 Aug 01 15:16:32.741026 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 179/348] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:32 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:33.186755 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d89484f7-0cf1-4571-a087-805346eaa4ed req-d250f311-2e3b-4dd9-af58-fab57e9de67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f6aeb2-92b5-4698-a380-4267e8765034", "name": "network-vif-unplugged", "status": "completed", "tag": "0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:33.197001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d89484f7-0cf1-4571-a087-805346eaa4ed req-d250f311-2e3b-4dd9-af58-fab57e9de67a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.197713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d89484f7-0cf1-4571-a087-805346eaa4ed req-d250f311-2e3b-4dd9-af58-fab57e9de67a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.212208 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d89484f7-0cf1-4571-a087-805346eaa4ed req-d250f311-2e3b-4dd9-af58-fab57e9de67a service nova] Creating event network-vif-unplugged:0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca for instance 41f6aeb2-92b5-4698-a380-4267e8765034 on hv-cinder-84327 Aug 01 15:16:33.217978 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d89484f7-0cf1-4571-a087-805346eaa4ed req-d250f311-2e3b-4dd9-af58-fab57e9de67a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034830 Aug 01 15:16:33.219195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 170/349] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:33.531457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:33.532304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:33.534013 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:33.535243 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:33.546229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.551845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.552955 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.554338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.562737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.563953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.564942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.565542 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.796652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:33.801070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:33.805388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-03ffc79f-869c-49d6-a8e0-5b9b8c723a5a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.277837 Aug 01 15:16:33.806041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 180/350] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:33 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:33.818786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-81663b42-a416-4f29-9dc3-52c7aaab9cd1 req-fc1ae457-569d-4fab-b3e7-d37207035a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f6aeb2-92b5-4698-a380-4267e8765034", "name": "network-vif-deleted", "tag": "0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:33.819134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c616334b-5b14-4de0-b283-fe6796173f74 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1322 microversion: 2.1 time: 0.284003 Aug 01 15:16:33.819134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 171/351] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:33 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:33.820372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:33.820488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-81663b42-a416-4f29-9dc3-52c7aaab9cd1 req-fc1ae457-569d-4fab-b3e7-d37207035a9e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.820920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-81663b42-a416-4f29-9dc3-52c7aaab9cd1 req-fc1ae457-569d-4fab-b3e7-d37207035a9e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.821043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:33.832336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.832336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.832336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.832336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.832757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-81663b42-a416-4f29-9dc3-52c7aaab9cd1 req-fc1ae457-569d-4fab-b3e7-d37207035a9e service nova] Creating event network-vif-deleted:0d6d8fb5-cf82-4ee0-b229-fdc40b95d2ca for instance 41f6aeb2-92b5-4698-a380-4267e8765034 on hv-cinder-84327 Aug 01 15:16:33.838504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-81663b42-a416-4f29-9dc3-52c7aaab9cd1 req-fc1ae457-569d-4fab-b3e7-d37207035a9e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 Aug 01 15:16:33.839111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 181/352] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:33.844040 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:33.844719 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:33.851499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.851955 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.852722 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.853145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.897663 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:33.905965 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-06a41bae-0a48-4d0b-a431-ee24b6f4d5c9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1516 microversion: 2.1 time: 0.090855 Aug 01 15:16:33.906527 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 172/353] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:33 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1516 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:33.990545 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:33.998326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d0c48a05-3020-43bb-ae97-d90a0bff4073 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.158105 Aug 01 15:16:33.998999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 182/354] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:33 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:34.834336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:34.835406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:34.840046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:34.840737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:34.851389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:34.855068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:34.857212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:34.857443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:34.858148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:34.859641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:34.860343 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:34.861045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.075816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:35.078483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:35.084378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-96cd0cc8-b598-4ac9-91db-a7ba9c41f7ad tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1512 microversion: 2.1 time: 0.248668 Aug 01 15:16:35.085154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 183/355] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:34 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:35.100437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4167b62b-96bc-4209-9777-ededbdc976c7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.258921 Aug 01 15:16:35.100437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 173/356] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:34 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:35.100437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:35.100437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:35.100437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.101425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.101425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.101425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.106529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:35.107165 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:35.113285 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.114033 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.115009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.115595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.214311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:35.225085 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-79b7e080-80ee-4cf9-98e9-96a87e84ccc9 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1350 microversion: 2.1 time: 0.136549 Aug 01 15:16:35.226288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 174/357] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:35 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:35.321222 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:35.329234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0cb03858-d9a2-4559-af57-ea88967e25c1 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.226266 Aug 01 15:16:35.343872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 184/358] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:35 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:35.457361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e2f0f1ef-e465-4422-a209-6f8aa567c571 req-ed39d0f6-254c-45ba-a542-5cdbc27a9349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90e2912-4c37-4113-82dd-d3efd79fa4da", "name": "network-vif-plugged", "status": "completed", "tag": "28ed31c6-23f1-4e75-8661-94191f64aac6"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:35.481167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e2f0f1ef-e465-4422-a209-6f8aa567c571 req-ed39d0f6-254c-45ba-a542-5cdbc27a9349 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.482177 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e2f0f1ef-e465-4422-a209-6f8aa567c571 req-ed39d0f6-254c-45ba-a542-5cdbc27a9349 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.524428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e2f0f1ef-e465-4422-a209-6f8aa567c571 req-ed39d0f6-254c-45ba-a542-5cdbc27a9349 service nova] Creating event network-vif-plugged:28ed31c6-23f1-4e75-8661-94191f64aac6 for instance c90e2912-4c37-4113-82dd-d3efd79fa4da on hv-cinder-84327 Aug 01 15:16:35.536837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-e2f0f1ef-e465-4422-a209-6f8aa567c571 req-ed39d0f6-254c-45ba-a542-5cdbc27a9349 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089295 Aug 01 15:16:35.538953 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 175/359] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:36.108065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:36.108683 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:36.114817 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:36.116253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.117045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:36.117543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.249567 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:36.250285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:36.257374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:36.258405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.259529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:36.260590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.331541 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:36.342651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-934e0973-e536-4a93-a791-15ef16a36679 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.238677 Aug 01 15:16:36.343894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 185/360] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:36 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:36.352689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:36.353709 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:36.372671 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:36.373798 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.375242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:36.376411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.447544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fc60410fab43a39bdb80478348ddae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a7e64a4f0a43599f9eeeb99e695f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:36.456475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9607515f-5e89-4023-9ce2-9499467d9ab0 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 200 len: 1350 microversion: 2.1 time: 0.212645 Aug 01 15:16:36.460089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 176/361] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:36 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 1350 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:36.877181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:36.887096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-af8beb7a-18f2-4bbd-9510-e2d42087addc tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.539546 Aug 01 15:16:36.888784 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 186/362] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:36 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:37.364808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:37.365511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:37.372020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.372466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.373228 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.373661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.477345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:37.477947 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:37.484096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.484786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.485563 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.485996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.501146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] HTTP exception thrown: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.512339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Request method failure captured: Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 HTTP/1.1 Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3hRAIwjxO5QkjiuaoxagdpKN5Uy8O2ILnCDmjuGU8WPUfLd1dk7-_pBth9ZjfSM4SGe6z2B_CBZSlUuZG8chouyEKad298uoqrtyOI3SEvOYP-TW0rzoQS470Z2KiZCECB5jzl1C1ZlA1IC8PqemGBNOOvoHFZ9Sr5Ims4MPIyRMk Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:16:37.517632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_85a7e64a4f0a43599f9eeeb99e695f24", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: e8fc60410fab43a39bdb80478348ddae Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.519246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '41f6aeb2-92b5-4698-a380-4267e8765034'} Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:16:37.520102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.521829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.522903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Returning 404 to user: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:16:37.522903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-aca06401-91d1-47e8-9b26-909a433372ef tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 404 len: 111 microversion: 2.1 time: 0.045813 Aug 01 15:16:37.523047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8628b4c4-438b-4887-ba4d-211ef1d78411 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.159377 Aug 01 15:16:37.523133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 187/363] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:37 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:16:37.523211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 177/364] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:37 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:37.641009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:37.643333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:37.649544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.650017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.650780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.651211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.664603 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] HTTP exception thrown: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Request method failure captured: Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034/os-volume_attachments HTTP/1.1 Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3hRAIwjxO5QkjiuaoxagdpKN5Uy8O2ILnCDmjuGU8WPUfLd1dk7-_pBth9ZjfSM4SGe6z2B_CBZSlUuZG8chouyEKad298uoqrtyOI3SEvOYP-TW0rzoQS470Z2KiZCECB5jzl1C1ZlA1IC8PqemGBNOOvoHFZ9Sr5Ims4MPIyRMk Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:16:37.666146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_85a7e64a4f0a43599f9eeeb99e695f24", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: e8fc60410fab43a39bdb80478348ddae Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.667680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'server_id': '41f6aeb2-92b5-4698-a380-4267e8765034'} Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:16:37.668427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:37.669557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:37.670986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Returning 404 to user: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:16:37.670986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3a75b34d-c6df-4feb-9e21-8cfe62ba8900 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031404 Aug 01 15:16:37.670986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 188/365] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:16:37 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:16:37.909309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:37.909920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:37.916034 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.916483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.917243 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.917678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.065573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:38.073252 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f196f7ee-94f2-424e-90a6-e5837aa87e55 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.167783 Aug 01 15:16:38.073820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 178/366] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:37 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:38.541927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:38.543263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:38.549676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:38.550128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.550962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:38.551394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.691962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:38.700461 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b11b6a96-a050-4812-bb83-93318c155c8e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.163352 Aug 01 15:16:38.701017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 189/367] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:38 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:38.888535 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:38.889030 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:38.897330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:38.897529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.898276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:38.898769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.913431 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] HTTP exception thrown: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Request method failure captured: Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 HTTP/1.1 Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3hRAIwjxO5QkjiuaoxagdpKN5Uy8O2ILnCDmjuGU8WPUfLd1dk7-_pBth9ZjfSM4SGe6z2B_CBZSlUuZG8chouyEKad298uoqrtyOI3SEvOYP-TW0rzoQS470Z2KiZCECB5jzl1C1ZlA1IC8PqemGBNOOvoHFZ9Sr5Ims4MPIyRMk Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:16:38.918740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_85a7e64a4f0a43599f9eeeb99e695f24", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: e8fc60410fab43a39bdb80478348ddae Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.920307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '41f6aeb2-92b5-4698-a380-4267e8765034'} Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:16:38.921196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.922541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.924225 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Returning 404 to user: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:16:38.924225 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f79a74a-903a-48d0-a593-d7a9a6952549 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 404 len: 111 microversion: 2.1 time: 0.035903 Aug 01 15:16:38.924225 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 179/368] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:16:38 2022] DELETE /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:16:38.929516 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:38.930409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] [instance: 41f6aeb2-92b5-4698-a380-4267e8765034] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:38.936456 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:38.936905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.937670 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:38.938102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.952177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] HTTP exception thrown: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Request method failure captured: Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 HTTP/1.1 Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3hRAIwjxO5QkjiuaoxagdpKN5Uy8O2ILnCDmjuGU8WPUfLd1dk7-_pBth9ZjfSM4SGe6z2B_CBZSlUuZG8chouyEKad298uoqrtyOI3SEvOYP-TW0rzoQS470Z2KiZCECB5jzl1C1ZlA1IC8PqemGBNOOvoHFZ9Sr5Ims4MPIyRMk Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:16:38.953672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_85a7e64a4f0a43599f9eeeb99e695f24", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/85a7e64a4f0a43599f9eeeb99e695f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 85a7e64a4f0a43599f9eeeb99e695f24 Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084741861 Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: e8fc60410fab43a39bdb80478348ddae Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-DeleteServersTestJSON-2084741861-project Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.955202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '41f6aeb2-92b5-4698-a380-4267e8765034'} Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:16:38.956302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. Aug 01 15:16:38.957608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:38.959415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] Returning 404 to user: Instance 41f6aeb2-92b5-4698-a380-4267e8765034 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:16:38.959415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9a960a1a-5fac-455d-8855-949ad5438244 tempest-DeleteServersTestJSON-2084741861 tempest-DeleteServersTestJSON-2084741861-project] 10.222.0.100 "GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034" status: 404 len: 111 microversion: 2.1 time: 0.029628 Aug 01 15:16:38.959415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 190/369] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:38 2022] GET /compute/v2.1/servers/41f6aeb2-92b5-4698-a380-4267e8765034 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:16:39.093825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:39.098350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:39.102358 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:39.103254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:39.104601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:39.105212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:39.357661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:39.366642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-99a6200e-f09c-42a5-8791-fc91e729c8f9 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1318 microversion: 2.1 time: 0.276676 Aug 01 15:16:39.370703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 180/370] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:39 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:39.721513 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:39.722443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:39.730223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:39.730750 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:39.731985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:39.733773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:39.964027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:39.977042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-53fdd615-5a18-49c5-af25-84656d916d26 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1527 microversion: 2.1 time: 0.259261 Aug 01 15:16:39.985747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 191/371] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:39 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1527 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:40.389337 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:40.389939 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:40.397208 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:40.397660 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.398440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:40.398914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.642195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:40.654398 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4144e534-3e4b-4b10-a31b-7b66c5085921 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1503 microversion: 2.1 time: 0.268603 Aug 01 15:16:40.655541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 181/372] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:40 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:41.015494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:41.015962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:41.029706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.030161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.031004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.032529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.037371 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:41.309078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:41.320627 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-84a99215-34ec-4dc6-aac9-d4257d89eaed tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1507 microversion: 2.1 time: 0.325162 Aug 01 15:16:41.322409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 192/373] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:40 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:41.345373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:41.346557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:41.352112 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:41.353093 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:41.361181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.361936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.362775 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.363218 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.369504 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.370283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.371803 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.372438 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.377295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:41.404010 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:16:41.525810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fa070322-16fa-41cc-9beb-26a4b151b567 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 204 len: 0 microversion: 2.1 time: 0.183297 Aug 01 15:16:41.532273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 182/374] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:16:41 2022] DELETE /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:16:41.551710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:41.552975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:41.573647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.574407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.575786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.576330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.679346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:41.691563 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-278c16e0-2889-48b2-b80d-462ee9e09d21 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1520 microversion: 2.1 time: 0.345387 Aug 01 15:16:41.707894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 193/375] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:41 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:41.922920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:41.934178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-751cc6d9-0ddc-4fbc-96c0-82a144ba4b34 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1509 microversion: 2.1 time: 0.400528 Aug 01 15:16:41.935025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 183/376] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:41 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:42.957534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:42.958312 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:42.970505 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:42.970981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:42.971736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:42.973298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:43.195309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:43.207101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f45c8375-caed-4097-9b5a-a3bfd5ae0d7b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1509 microversion: 2.1 time: 0.254231 Aug 01 15:16:43.207867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 194/377] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:42 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:44.229780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:44.231294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:44.253199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:44.253640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:44.254408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:44.254878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:44.413220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:44.416269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:44.436013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:44.442544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:44.446993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:44.449424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:44.538133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lazy-loading 'flavor' on Instance uuid c40bc31b-5c78-49e5-99ea-0cc891add3c4 {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:16:44.541229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:44.549787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3ba3eea-794a-472c-87eb-52533ff59aad tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1509 microversion: 2.1 time: 0.324286 Aug 01 15:16:44.556235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 184/378] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:44 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:44.718890 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-82141de5-9196-4331-b0d5-c31846ea8030 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/action" status: 200 len: 32 microversion: 2.1 time: 0.313847 Aug 01 15:16:44.720922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 195/379] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:16:44 2022] POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:16:44.731437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:44.732812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:44.746818 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:44.748222 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:44.750412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:44.751630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.033195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-bd8a8e04-82a4-49c8-9aa7-aab8a9778511 req-603f0e06-5705-47ab-8259-81b4ff9941d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90e2912-4c37-4113-82dd-d3efd79fa4da", "name": "network-vif-deleted", "tag": "28ed31c6-23f1-4e75-8661-94191f64aac6"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:45.085901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-bd8a8e04-82a4-49c8-9aa7-aab8a9778511 req-603f0e06-5705-47ab-8259-81b4ff9941d5 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.087242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-bd8a8e04-82a4-49c8-9aa7-aab8a9778511 req-603f0e06-5705-47ab-8259-81b4ff9941d5 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.110208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-bd8a8e04-82a4-49c8-9aa7-aab8a9778511 req-603f0e06-5705-47ab-8259-81b4ff9941d5 service nova] Creating event network-vif-deleted:28ed31c6-23f1-4e75-8661-94191f64aac6 for instance c90e2912-4c37-4113-82dd-d3efd79fa4da on hv-cinder-84327 Aug 01 15:16:45.118635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-bd8a8e04-82a4-49c8-9aa7-aab8a9778511 req-603f0e06-5705-47ab-8259-81b4ff9941d5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090452 Aug 01 15:16:45.119872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 196/380] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:45.156900 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:45.168352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-46a2e808-fa31-4fde-b01c-81b7bd513caf tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.441664 Aug 01 15:16:45.168934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 185/381] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:44 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:45.593691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:45.595181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:45.606404 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.606980 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.607829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.608352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.646879 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.647410 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.648059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lazy-loading 'fault' on Instance uuid c90e2912-4c37-4113-82dd-d3efd79fa4da {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:16:45.725636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:45.741365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f2103dab-82d7-459f-866b-281415c48a19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 200 len: 1308 microversion: 2.1 time: 0.163965 Aug 01 15:16:45.742053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 197/382] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:45 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:46.190254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:46.191474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:46.200371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.200988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.201982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.202987 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.445918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:46.454861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-012b840f-3993-45d1-bad6-19ac13dafe4c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.269088 Aug 01 15:16:46.455793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 186/383] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:46 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:46.765820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:46.767716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: c90e2912-4c37-4113-82dd-d3efd79fa4da] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:46.778736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.779694 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.782351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.783653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.814895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] HTTP exception thrown: Instance c90e2912-4c37-4113-82dd-d3efd79fa4da could not be found. Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Request method failure captured: Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da HTTP/1.1 Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-4681DGpUulplj-zZwu253XReMidnmHRHXMumQTJgzx60cHc4wyolBKb5eru4oRIGV0rzP7ixwqgfUq6MzB1g2PbPaVqMG9loXG_sldSYNGrU3fPznkzFe3yQt2Af1VoBCP2B7WYCxPiASwcLtc5utIjRfVJzSHD9ru-lJRDPojLts Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: cc38647adf7e41beb5c47c01149972e0 Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesActionsTest-678223116 Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:16:46.822925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_cc38647adf7e41beb5c47c01149972e0", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cc38647adf7e41beb5c47c01149972e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/cc38647adf7e41beb5c47c01149972e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cc38647adf7e41beb5c47c01149972e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesActionsTest-678223116 Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: cc38647adf7e41beb5c47c01149972e0 Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesActionsTest-678223116 Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesActionsTest-678223116-project Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 55bb7887d98f458688cffbccf4a64b53 Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesActionsTest-678223116-project Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance c90e2912-4c37-4113-82dd-d3efd79fa4da could not be found. Aug 01 15:16:46.824400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'c90e2912-4c37-4113-82dd-d3efd79fa4da'} Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90e2912-4c37-4113-82dd-d3efd79fa4da could not be found. Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:16:46.825215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90e2912-4c37-4113-82dd-d3efd79fa4da could not be found. Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90e2912-4c37-4113-82dd-d3efd79fa4da could not be found. Aug 01 15:16:46.826378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:16:46.834938 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Returning 404 to user: Instance c90e2912-4c37-4113-82dd-d3efd79fa4da could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:16:46.836058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4d707b71-25ae-4628-8e6f-084f92730733 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da" status: 404 len: 111 microversion: 2.1 time: 0.075740 Aug 01 15:16:46.836701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 198/384] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:46 2022] GET /compute/v2.1/servers/c90e2912-4c37-4113-82dd-d3efd79fa4da => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:16:46.978447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-59903574", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "networks": [{"uuid": "72291a58-b102-4cc6-8357-f762588ae4bf"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:47.041256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] validate_networks() for [('72291a58-b102-4cc6-8357-f762588ae4bf', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:16:47.478218 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:47.479368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:47.487001 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:47.487597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:47.488643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:47.489294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:47.733494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:47.743305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d6bfbde1-6965-44a0-9611-b17c78c3e0a8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.269756 Aug 01 15:16:47.744480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 199/385] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:47 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:47.761228 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:16:47.762207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:16:47.762890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:16:47.763458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:16:47.763869 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:16:47.780562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:47.782958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:47.783959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:47.784683 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:47.803500 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Getting quotas for project cc38647adf7e41beb5c47c01149972e0. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:16:47.809024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Getting quotas for user 55bb7887d98f458688cffbccf4a64b53 and project cc38647adf7e41beb5c47c01149972e0. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:16:47.822716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:16:47.825214 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:16:47.887975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c51cb9c2-1200-4b63-b1a7-ffd39645c468 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.913498 Aug 01 15:16:47.889235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 187/386] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:16:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:16:47.900636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d2af798c-0e1e-414f-9a30-2c6d90b6891f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:47.901233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d2af798c-0e1e-414f-9a30-2c6d90b6891f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:48.034579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d2af798c-0e1e-414f-9a30-2c6d90b6891f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:48.046495 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d2af798c-0e1e-414f-9a30-2c6d90b6891f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1216 microversion: 2.1 time: 0.149775 Aug 01 15:16:48.047130 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 200/387] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:47 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:48.767266 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:48.768401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:48.778830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:48.779590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:48.780298 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:48.780771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:49.005077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:49.014168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6361c2c9-d935-47c2-b7d3-381eada54147 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.252591 Aug 01 15:16:49.014942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 188/388] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:48 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:49.081511 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:49.082353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:49.089146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:49.089615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:49.090377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:49.090837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:49.316922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:49.326358 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5381fb65-6f35-4896-a6e2-19fd27608853 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1268 microversion: 2.1 time: 0.259029 Aug 01 15:16:49.327600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 201/389] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:49 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:50.036140 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:50.036954 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:50.060181 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:50.060894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.061678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:50.062111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.342950 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:50.360201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:50.360835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:50.364959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec5d8894-6cff-4662-a502-cc47953e75d2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.332842 Aug 01 15:16:50.379697 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 189/390] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:50 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:50.382184 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:50.382645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.383474 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:50.383997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.596436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:50.605916 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6059795d-1198-497b-86bf-33a502bb7e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.260575 Aug 01 15:16:50.606488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 202/391] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:50 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:51.390445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:51.392561 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:51.406744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.407800 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.409238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.410225 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.632880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:51.637337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:51.659937 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.662126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.663508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.665530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.727896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:51.754653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1b0cc62f-6e7e-4f6c-9f03-d798ce6b9445 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.370036 Aug 01 15:16:51.755954 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 190/392] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:51 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:51.831931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:51.840265 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2497c2dd-e3d4-4f63-8dd0-c3e254a8a5f5 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.215733 Aug 01 15:16:51.842121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 203/393] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:51 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:52.072608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-c4f9f514-e5f9-4fae-b212-c8fb910266e0 req-b40855aa-9243-427b-965d-9657bbc9cbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5efac1-8c95-4047-a2bd-c5ed504b0028", "tag": "7adf8e7b-4f1f-4c92-92e2-1a92c1144106"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:52.091092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c4f9f514-e5f9-4fae-b212-c8fb910266e0 req-b40855aa-9243-427b-965d-9657bbc9cbb2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.092227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c4f9f514-e5f9-4fae-b212-c8fb910266e0 req-b40855aa-9243-427b-965d-9657bbc9cbb2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:52.106626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-c4f9f514-e5f9-4fae-b212-c8fb910266e0 req-b40855aa-9243-427b-965d-9657bbc9cbb2 service nova] Creating event network-changed:7adf8e7b-4f1f-4c92-92e2-1a92c1144106 for instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 on hv-cinder-84327 Aug 01 15:16:52.125040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-c4f9f514-e5f9-4fae-b212-c8fb910266e0 req-b40855aa-9243-427b-965d-9657bbc9cbb2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055700 Aug 01 15:16:52.126060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 191/394] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:52.793633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:52.794394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:52.804102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.805322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:52.806359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.807206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:52.865200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:52.868796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:52.883322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.899995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:52.901107 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.901708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:53.101149 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:53.108900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3ebbe909-1145-4fdf-8f2b-1c2e5dc7e5d9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.321250 Aug 01 15:16:53.109468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 204/395] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:52 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:53.189121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:53.198228 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3b223b84-fd4f-4962-858d-f7e3b87a12a4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.338386 Aug 01 15:16:53.211118 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 192/396] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:52 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:54.136540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:54.137150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:54.146547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:54.147378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.148378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:54.149007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.218957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:54.219561 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:54.229760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:54.230206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.231036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:54.231462 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.451677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:54.464802 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c52d6d90-84f7-4e6b-8784-f1cdf0cb8c67 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.334517 Aug 01 15:16:54.466368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 205/397] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:54 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:54.523025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:54.530755 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3bf07f1a-d5f0-4b7a-83d4-43b716132e6c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.315602 Aug 01 15:16:54.532920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 193/398] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:54 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:55.487668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:55.488781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:55.495575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.496022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.496990 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.497431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.557870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:55.558496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:55.565265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.565714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.566871 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.567853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.786027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:55.795470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c8cddeb1-cc36-49df-9f07-ecfe9df3d5d4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.311527 Aug 01 15:16:55.796053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 206/399] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:55 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:55.860935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:55.884315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c3f343f-917a-4930-85d8-046366c60730 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.330635 Aug 01 15:16:55.885558 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 194/400] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:55 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:56.818154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:56.818883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:56.825364 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:56.825807 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:56.826772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:56.827380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:56.864580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0b216f21-f563-4471-bd5b-205ab82eedac tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Action: 'create', calling method: .version_select at 0x7efd1dc7f0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-505595786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQwxR7JgjZHNShzwVnH6xfnFasmcL+5sObRmFxIMkcq8RB6VeZQ5OGnDtKF3HBGOG6/+8xJE8GjKKM/CqseMacnmR6pmIRiIppq2E1U3DwCxULOYhiIfYYvgBDYC0uHgg=="}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:56.886318 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-0b216f21-f563-4471-bd5b-205ab82eedac tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for project f44ad042ba9b4bdc91783fce54774c29. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:16:56.890771 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-0b216f21-f563-4471-bd5b-205ab82eedac tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for user c6795a827b8d411aaa165db7b38435ce and project f44ad042ba9b4bdc91783fce54774c29. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:16:56.938144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0b216f21-f563-4471-bd5b-205ab82eedac tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.285631 Aug 01 15:16:56.938896 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 207/401] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:16:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:56.944699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:56.945597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:56.956255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:56.956788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:56.957641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:56.958141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:56.998109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:57.007886 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c088d525-b968-49b8-b06d-b00bc8479bf9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.194248 Aug 01 15:16:57.009056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 195/402] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:56 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:57.124376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:57.134044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ae966a33-5915-49cc-9fbd-74f7e7b3170a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.193870 Aug 01 15:16:57.134623 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 208/403] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:56 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:58.031990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:58.032605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:58.038280 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:58.039329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:58.041895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:58.042447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:58.043192 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:58.043627 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:58.155500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:58.156840 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:58.165284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:58.165978 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:58.167387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:58.168862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:58.246527 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:58.271979 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d775080a-33ba-4d7c-9755-d0f0d94fe097 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.243765 Aug 01 15:16:58.272790 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 196/404] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:58 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:58.335496 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:58.342773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:58.352654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3a53b312-169a-426e-a632-43417d3b2c7d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.201076 Aug 01 15:16:58.354417 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 209/405] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:58 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:59.297859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:59.298465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:59.308048 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:59.309876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.310654 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.311735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.312194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.375325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:59.376049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:59.384757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.385499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.386288 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.386739 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.526737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.536648 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-899d04e9-d2d1-4d73-8593-ebf01968583c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.242240 Aug 01 15:16:59.537928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 197/406] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:59 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:59.584272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.592097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-cce6ad02-826d-477f-a5d6-72419f082e19 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.221286 Aug 01 15:16:59.592595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 210/407] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:16:59 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:00.559872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:00.560603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:00.568132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.568867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.569724 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.570380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.592593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:00.619154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:00.621475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:00.633103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.633842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.635213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.636128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.775721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.785448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c44973cb-8eea-4e4f-b703-3facd7ed059c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.229705 Aug 01 15:17:00.786564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 198/408] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:00 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:00.847967 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.855585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7918631d-0565-4484-8d66-de4e30afdc41 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.241889 Aug 01 15:17:00.856175 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 211/409] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:00 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:01.808243 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:01.809500 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:01.826277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.826951 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.828310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.828904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.877658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:01.878389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:01.892854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:01.897829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.897829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.897829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.898483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:02.075909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:02.092515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f56eba78-1d5f-4e17-987d-2081b57ae348 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.288378 Aug 01 15:17:02.093272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 199/410] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:01 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:02.106634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:02.116865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-17e006bc-0431-481e-9f3f-deabbdd00326 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.244317 Aug 01 15:17:02.117869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 212/411] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:01 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:03.113377 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:03.114609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:03.121246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.121682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.122457 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.122920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.139339 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:03.140071 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:03.146685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.147232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.148058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.148606 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.354835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.355142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.363353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-00c107f9-7201-42ce-b178-35bf1ff712ac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.253705 Aug 01 15:17:03.364440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 200/412] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:03 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:03.370735 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bfc3a3e3-0435-4ba7-abe1-f0f01f8cc94f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.235099 Aug 01 15:17:03.385810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 213/413] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:03 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:04.385753 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:04.386220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:04.393185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.393377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:04.393822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.394397 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.394879 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:04.395993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.402092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.402620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.403840 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.404604 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.636807 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.644383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82177bbb-c755-4ba0-8bb7-680b192c0678 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.262419 Aug 01 15:17:04.644861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 201/414] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:04 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:04.646829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.658269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0ddb5630-c18a-45c0-b4d8-c5f89fba8e4d tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.268802 Aug 01 15:17:04.672547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 214/415] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:04 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:05.665397 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.666022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:05.672035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.672486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.673255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.673690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.680571 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.681995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:05.688058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.688493 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.689617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.690422 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.898097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:05.903930 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:05.911344 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-335f3a7c-ca2e-4998-8643-035316727e5f tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.232296 Aug 01 15:17:05.911344 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 215/416] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:05.916046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa72037c-555a-41a3-9997-30fb5643acad tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.254558 Aug 01 15:17:05.916617 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 202/417] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:06.928608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:06.929216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:06.931190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:06.937306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.937753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.938521 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.938985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.939595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:06.940689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:06.951238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.951957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.953295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.953972 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:07.126768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:07.135239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-39f9193e-91d5-469d-b040-9abfff51cd7a tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.210469 Aug 01 15:17:07.142722 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 216/418] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:06 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:07.152680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:07.161681 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7a7ae5fa-ae6c-4428-9608-72d1d03979cd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.228192 Aug 01 15:17:07.162263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 203/419] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:06 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:08.161629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:08.162245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:08.168377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.168825 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.169589 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.170025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.182427 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:08.183064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:08.190489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.191007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.192568 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.193249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.384740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:08.412536 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:08.415082 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3bf1d904-2a28-4b29-b496-b0e8ea8aff70 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.257475 Aug 01 15:17:08.426695 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 217/420] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:08 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:08.432766 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-80c8ba2c-4a87-4926-a052-99e74a50b8c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.254036 Aug 01 15:17:08.433670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 204/421] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:08 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:08.435891 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-767438b1-bac6-4fb6-b4ef-86c4bc5c7100 req-21b9d3d1-6941-4c04-b600-4a4053129def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5efac1-8c95-4047-a2bd-c5ed504b0028", "name": "network-vif-plugged", "status": "completed", "tag": "7adf8e7b-4f1f-4c92-92e2-1a92c1144106"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:08.448375 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-767438b1-bac6-4fb6-b4ef-86c4bc5c7100 req-21b9d3d1-6941-4c04-b600-4a4053129def service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.448817 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-767438b1-bac6-4fb6-b4ef-86c4bc5c7100 req-21b9d3d1-6941-4c04-b600-4a4053129def service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.463330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-767438b1-bac6-4fb6-b4ef-86c4bc5c7100 req-21b9d3d1-6941-4c04-b600-4a4053129def service nova] Creating event network-vif-plugged:7adf8e7b-4f1f-4c92-92e2-1a92c1144106 for instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 on hv-cinder-84327 Aug 01 15:17:08.468518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-767438b1-bac6-4fb6-b4ef-86c4bc5c7100 req-21b9d3d1-6941-4c04-b600-4a4053129def service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051760 Aug 01 15:17:08.469107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 218/422] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:09.443086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.443618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:09.454300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:09.454300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:09.454300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:09.454300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:09.463310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.463310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:09.471697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:09.472229 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:09.473374 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:09.474155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:09.703305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:09.704976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:09.718990 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3e78897c-d52a-48f1-9459-688647d21292 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.267622 Aug 01 15:17:09.721904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0c17ae1c-8a86-4f02-b461-56569125d147 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.283103 Aug 01 15:17:09.722535 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 205/423] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:09 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:09.724005 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 219/424] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:09 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:10.743832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:10.744913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:10.745882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:10.746874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:10.750810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.751256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.752066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.752502 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.753513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.753962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.754993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.755446 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.964997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:10.969502 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:10.973239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-015392aa-0dc0-4880-954f-f6c2ccfb8fef tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1316 microversion: 2.1 time: 0.233188 Aug 01 15:17:10.974177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 220/425] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:10 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:10.978039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e2093f57-a100-4bd0-ade2-7f225280fca1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1506 microversion: 2.1 time: 0.236572 Aug 01 15:17:10.978887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 206/426] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:10 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:10.999212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f33bd7bf-230b-4785-a9e8-1f105cede196"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:11.001626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:11.009472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.010036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.010942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.011486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.039429 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] HTTP exception thrown: Cannot 'attach_volume' instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 while it is in vm_state rescued Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Request method failure captured: Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/os-volume_attachments HTTP/1.1 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 74 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3iRa8nQuz8zJJ7zw4P6ORCW9wvF07J4tE_ci1BHwJVgFzKip30UyoE2M1ulTMJfh56fxizdNXnDDlcVxQtCyN9QzatO7rFkjIaEWa9yLtQ3G8GgCI796IsVloBdCYJ05MJ7CNX_dhWIhLF5oyNi3Rhk3mm7Vlv7JvTMnrC067Yxx4 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:17:11.041118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e5e42e0f0ef74615ac27486ada272fd8", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: ca1d32ee23bc42b38ea9a043f7a850f5 Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {"volumeAttachment": {"volumeId": "f33bd7bf-230b-4785-a9e8-1f105cede196"}} Aug 01 15:17:11.042652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Cannot 'attach_volume' instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 while it is in vm_state rescued Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'server_id': 'c40bc31b-5c78-49e5-99ea-0cc891add3c4', 'body': {'volumeAttachment': {'volumeId': 'f33bd7bf-230b-4785-a9e8-1f105cede196'}}} Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:11.043534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 while it is in vm_state rescued Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:11.045423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 while it is in vm_state rescued Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Returning 409 to user: Cannot 'attach_volume' instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 while it is in vm_state rescued {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b0ba8895-41d3-45a6-8295-f2783cea67d3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047647 Aug 01 15:17:11.047084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 221/427] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:17:10 2022] POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:17:11.052954 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:11.053499 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:11.059859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.060309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.061094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.061533 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.132058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-65689188-8e41-4aed-a277-38e143a0cf44 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/action" status: 202 len: 0 microversion: 2.1 time: 0.083050 Aug 01 15:17:11.132740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 207/428] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:17:11 2022] POST /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:17:11.141591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.142197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:11.150236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.150710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.151480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.152713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.292994 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:11.303450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-05436368-68eb-4577-bf45-ff12f8b9d02b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.166265 Aug 01 15:17:11.303865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 222/429] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:11.994982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.995696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:12.002611 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.003087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.003859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.004332 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.143477 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:12.151199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2d2915d0-9432-4c31-bfe7-ed7b94e14de4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1500 microversion: 2.1 time: 0.160917 Aug 01 15:17:12.151813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 208/430] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:12.326101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:12.327446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:12.340001 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.341541 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.344289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.367931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.656067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:12.666298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fa1a03f4-2fb3-4ac0-aff3-f2e2ae426abb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.344956 Aug 01 15:17:12.667187 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 223/431] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:12 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:12.958714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:12.959328 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:12.965896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.966346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.967152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.967588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.992487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:17:13.083322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5a725e0e-73e5-4e72-88c3-0e0cffc76d51 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 204 len: 0 microversion: 2.1 time: 0.129668 Aug 01 15:17:13.084053 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 209/432] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:17:12 2022] DELETE /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:17:13.094238 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:13.094884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:13.102058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.102584 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.103554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.104056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.495703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:13.529302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9d4ef353-3ab9-4a8d-a49d-072c570683b4 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1506 microversion: 2.1 time: 0.438869 Aug 01 15:17:13.547496 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 224/433] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:13 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:13.702181 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:13.702955 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:13.710105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.710694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.711499 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.711952 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.855146 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:13.863878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c34aa33-6eb7-4576-9993-98113779290f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.165940 Aug 01 15:17:13.864447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 210/434] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:13 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:14.569126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:14.569759 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:14.576987 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.577718 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.578992 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.579581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.641505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa0a1a68-98da-45ac-8172-2e940d2e8d77", "device": "/dev/sdb"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:14.650303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:14.666283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.670570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.672161 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.672771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.773894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:14.781869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-48c2690e-b9a0-4cd9-8237-e5ada4f4f7df tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1506 microversion: 2.1 time: 0.216967 Aug 01 15:17:14.782423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 225/435] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:14 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:14.886183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:14.887266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:14.893262 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.893707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.894501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.894963 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.022309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:15.029724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9d60f30e-ab9e-4de8-bfb8-d603e7db60ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.147542 Aug 01 15:17:15.030283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 226/436] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:14 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:15.805649 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:15.806534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:15.816362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:15.817072 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.818734 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:15.819063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.845105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:15.970453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:15.978561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1e0e802b-1357-4b43-ba8c-f3356f5daf58 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1506 microversion: 2.1 time: 0.178807 Aug 01 15:17:15.979384 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 227/437] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:15 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:16.050995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:16.051606 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:16.058440 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:16.058809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:16.059599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:16.060036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:16.203171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:16.213212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c0b9bc12-231a-4462-86c6-96a4d1d6e9e1 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.166153 Aug 01 15:17:16.213796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 228/438] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:16 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:17.003181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:17.004609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:17.011183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:17.011956 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:17.012709 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:17.013319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:17.150292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:17.157840 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-216ea061-df44-4730-b9e7-6523a8874e6b tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1506 microversion: 2.1 time: 0.162140 Aug 01 15:17:17.158438 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 229/439] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:16 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:17.233198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:17.233791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:17.240167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:17.240627 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:17.241456 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:17.242046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:17.375872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:17.383963 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-70ff825a-d524-4202-b564-d9b6cf867a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.154478 Aug 01 15:17:17.385128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 230/440] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:17 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:17.862147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:17.894276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3d905385-b48b-46e9-9714-e3bcc02bed6a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "POST /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.264897 Aug 01 15:17:17.894276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 211/441] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:17:14 2022] POST /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd/os-volume_attachments => generated 194 bytes in 3267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:17:18.177894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:18.179146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:18.187168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.187859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.188667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.189702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.259423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:18.268703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3e493c5f-204a-49db-9d09-4da9e966897c tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1464 microversion: 2.1 time: 0.094727 Aug 01 15:17:18.269862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 231/442] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:18 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:18.306414 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4b53ddc5-48d0-4c54-9d9a-0b45a7ed8c14 req-e5f97849-90da-49a1-bb3e-075e7b897d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5efac1-8c95-4047-a2bd-c5ed504b0028", "name": "network-vif-deleted", "tag": "7adf8e7b-4f1f-4c92-92e2-1a92c1144106"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:18.316925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4b53ddc5-48d0-4c54-9d9a-0b45a7ed8c14 req-e5f97849-90da-49a1-bb3e-075e7b897d83 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.317386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4b53ddc5-48d0-4c54-9d9a-0b45a7ed8c14 req-e5f97849-90da-49a1-bb3e-075e7b897d83 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.328912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4b53ddc5-48d0-4c54-9d9a-0b45a7ed8c14 req-e5f97849-90da-49a1-bb3e-075e7b897d83 service nova] Creating event network-vif-deleted:7adf8e7b-4f1f-4c92-92e2-1a92c1144106 for instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 on hv-cinder-84327 Aug 01 15:17:18.334279 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4b53ddc5-48d0-4c54-9d9a-0b45a7ed8c14 req-e5f97849-90da-49a1-bb3e-075e7b897d83 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033419 Aug 01 15:17:18.335062 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 212/443] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:18.407328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:18.407844 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:18.414588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.415078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.415940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.416379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.592642 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:18.601208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5bf20db1-3e5b-46a2-a5b3-db17942eccb4 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1514 microversion: 2.1 time: 0.199030 Aug 01 15:17:18.602061 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 232/444] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:18 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:19.291268 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:19.292028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:19.298530 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.299053 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.299820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.300252 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.336640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.336981 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.337424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lazy-loading 'fault' on Instance uuid 9a5efac1-8c95-4047-a2bd-c5ed504b0028 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:17:19.384178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb7887d98f458688cffbccf4a64b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc38647adf7e41beb5c47c01149972e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:19.392281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dbc82073-8c61-43bd-bbda-7b04ce04a6de tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 200 len: 1306 microversion: 2.1 time: 0.106603 Aug 01 15:17:19.393105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 213/445] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:19 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:19.626452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:19.627109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:19.635152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.635616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.636780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.637833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.791391 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:19.799405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-eef33b8c-49f0-4e4a-b4d9-a7ab3a9d1191 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1520 microversion: 2.1 time: 0.177240 Aug 01 15:17:19.800048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 233/446] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:19 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:20.413015 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:20.413633 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] [instance: 9a5efac1-8c95-4047-a2bd-c5ed504b0028] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:20.420200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:20.420652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:20.421420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:20.421859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:20.435880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] HTTP exception thrown: Instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 could not be found. Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Request method failure captured: Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 HTTP/1.1 Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-4681DGpUulplj-zZwu253XReMidnmHRHXMumQTJgzx60cHc4wyolBKb5eru4oRIGV0rzP7ixwqgfUq6MzB1g2PbPaVqMG9loXG_sldSYNGrU3fPznkzFe3yQt2Af1VoBCP2B7WYCxPiASwcLtc5utIjRfVJzSHD9ru-lJRDPojLts Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: cc38647adf7e41beb5c47c01149972e0 Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesActionsTest-678223116 Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:17:20.437622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_cc38647adf7e41beb5c47c01149972e0", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cc38647adf7e41beb5c47c01149972e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/cc38647adf7e41beb5c47c01149972e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cc38647adf7e41beb5c47c01149972e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesActionsTest-678223116 Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: cc38647adf7e41beb5c47c01149972e0 Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesActionsTest-678223116 Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesActionsTest-678223116-project Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 55bb7887d98f458688cffbccf4a64b53 Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesActionsTest-678223116-project Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 could not be found. Aug 01 15:17:20.439059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '9a5efac1-8c95-4047-a2bd-c5ed504b0028'} Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 could not be found. Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:20.440371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 could not be found. Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 could not be found. Aug 01 15:17:20.442383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:17:20.443587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] Returning 404 to user: Instance 9a5efac1-8c95-4047-a2bd-c5ed504b0028 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:20.443587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-700cf8f6-eacb-4b15-a191-3e0b049caa82 tempest-VolumesActionsTest-678223116 tempest-VolumesActionsTest-678223116-project] 10.222.0.100 "GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028" status: 404 len: 111 microversion: 2.1 time: 0.030623 Aug 01 15:17:20.443587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 214/447] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:20 2022] GET /compute/v2.1/servers/9a5efac1-8c95-4047-a2bd-c5ed504b0028 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:17:22.295676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8918be62-de93-4671-b0e9-5411cf998ffa tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'create', calling method: .version_select at 0x7efd1daed790>, body: {"keypair": {"name": "tempest-keypair-2140335652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkLRXJaOx3ctfUkI2pT6/UnsffXN4z86RdtTRMTciroGWUePQYpk4hMQwiy1MNrpHxHoSRxAuhn17t3WT5CJy8iFHHikTVdqByd9Az4buWGWAopHY16HMLmdHdHJPl+PA=="}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:22.312006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-8918be62-de93-4671-b0e9-5411cf998ffa tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:17:22.317104 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-8918be62-de93-4671-b0e9-5411cf998ffa tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for user ca1d32ee23bc42b38ea9a043f7a850f5 and project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:17:22.343337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8918be62-de93-4671-b0e9-5411cf998ffa tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051521 Aug 01 15:17:22.343939 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 234/448] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:17:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:23.831044 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-406817201", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfb293c1-f2bd-4025-8b87-d35edaff94c1"}], "security_groups": [{"name": "tempest-securitygroup--846550955"}], "key_name": "tempest-keypair-2140335652", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:23.957249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] validate_networks() for [('cfb293c1-f2bd-4025-8b87-d35edaff94c1', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:17:24.390472 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:17:24.390944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:17:24.391426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:17:24.391834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:17:24.392243 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:17:24.402079 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:24.402527 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:24.403385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:24.403833 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:24.424569 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:17:24.430070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Getting quotas for user ca1d32ee23bc42b38ea9a043f7a850f5 and project e5e42e0f0ef74615ac27486ada272fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:17:24.442560 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:17:24.444875 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:17:24.496868 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dbdab463-2e2f-4e88-bdc9-501df8c4794d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 0.669726 Aug 01 15:17:24.497741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 215/449] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:17:23 2022] POST /compute/v2.1/servers => generated 410 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:17:24.509288 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-332d7b5d-212e-43e0-9245-709fcf011db7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:24.509913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-332d7b5d-212e-43e0-9245-709fcf011db7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:24.568822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-332d7b5d-212e-43e0-9245-709fcf011db7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:24.576008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-332d7b5d-212e-43e0-9245-709fcf011db7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1249 microversion: 2.1 time: 0.070640 Aug 01 15:17:24.576601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 235/450] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:24 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:25.598250 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:25.598889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:25.605264 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:25.606049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:25.606646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:25.607123 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:25.674303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:25.682259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7a1394e4-514c-4c14-aacc-4810b207bb37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1253 microversion: 2.1 time: 0.089108 Aug 01 15:17:25.683148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 216/451] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:25 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:26.708305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:26.708859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:26.715451 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:26.716055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:26.716848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:26.717326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:26.787250 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:26.795349 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ce492b49-4327-4887-9e1b-737e4e29734b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1253 microversion: 2.1 time: 0.091921 Aug 01 15:17:26.795933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 236/452] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:26 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:27.818430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:27.819244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:27.826483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:27.826957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:27.827804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:27.828137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:27.895457 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:27.903584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-170802e8-699a-4a00-b431-283dcd699bd7 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1253 microversion: 2.1 time: 0.089846 Aug 01 15:17:27.904157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 217/453] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:27 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:28.924645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:28.925345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:28.931646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:28.932082 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:28.932848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:28.933277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:28.998885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:29.006775 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-02be4a03-681d-4563-ba8e-3bf4089e855c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1245 microversion: 2.1 time: 0.086005 Aug 01 15:17:29.007427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 237/454] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:28 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:30.028317 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:30.028919 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:30.031452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:30.037495 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:30.037938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:30.038727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:30.039164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:30.111654 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:30.121073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d2802c00-4274-41a1-b1f2-f51e2eb7c3b2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1245 microversion: 2.1 time: 0.096499 Aug 01 15:17:30.121650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 218/455] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:30 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:31.147812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:31.149414 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:31.191668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:31.193631 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:31.199895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:31.201704 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:31.287056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:31.303692 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6c8daba1-2ae0-4372-ac52-7cda8452b046 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1301 microversion: 2.1 time: 0.161755 Aug 01 15:17:31.307136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 238/456] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:31 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1301 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:32.324357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:32.326429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:32.337884 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:32.338790 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:32.339816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:32.340526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:32.411959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:32.422021 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c90c1439-6fa9-4159-a073-ec7636acbd0a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1307 microversion: 2.1 time: 0.101547 Aug 01 15:17:32.435139 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 219/457] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:32 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:33.447055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:33.447651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:33.449464 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:33.455544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:33.455985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:33.456765 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:33.457191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:33.590634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:33.598793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4fca6a5e-69df-463b-bee1-ca87c8f43b9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.156382 Aug 01 15:17:33.599364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 239/458] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:33 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:34.618871 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:34.619496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:34.621802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:34.622469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:34.629357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:34.629808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:34.630612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:34.631182 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:34.765782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:34.773402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-817c6140-38cf-43de-9b55-c088fdc0ebac tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.158375 Aug 01 15:17:34.773988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 220/459] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:34 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:35.794852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:35.796230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:35.799277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:35.820135 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:35.820600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:35.821413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:35.821848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:36.086423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:36.095263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a39706d7-2a08-4a56-a856-0ec94d523d57 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.304313 Aug 01 15:17:36.116280 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 240/460] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:35 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:36.333807 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-fbbff006-6363-48de-a8a0-9f5f5dadf9a1 req-eb01209d-b9b2-4c0c-9a2e-67ec93156a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e33525-a6db-4813-8a29-1c5a1c5b33eb", "tag": "f47c057c-d9e2-4139-887f-aa554c5d32e5"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:36.365711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fbbff006-6363-48de-a8a0-9f5f5dadf9a1 req-eb01209d-b9b2-4c0c-9a2e-67ec93156a1e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:36.366649 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fbbff006-6363-48de-a8a0-9f5f5dadf9a1 req-eb01209d-b9b2-4c0c-9a2e-67ec93156a1e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:36.388637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-fbbff006-6363-48de-a8a0-9f5f5dadf9a1 req-eb01209d-b9b2-4c0c-9a2e-67ec93156a1e service nova] Creating event network-changed:f47c057c-d9e2-4139-887f-aa554c5d32e5 for instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb on hv-cinder-84327 Aug 01 15:17:36.398210 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-fbbff006-6363-48de-a8a0-9f5f5dadf9a1 req-eb01209d-b9b2-4c0c-9a2e-67ec93156a1e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074193 Aug 01 15:17:36.398935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 221/461] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:37.123706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:37.124452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:37.132566 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.133395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.134494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.135314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.353095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:37.372425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b7692bc6-9fda-42db-9364-921f0a251755 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.252190 Aug 01 15:17:37.373513 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 241/462] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:37 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:38.407283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:38.408902 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:38.416788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:38.417503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.418760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:38.419395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.619207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:38.628406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8f486ab3-c807-490c-9160-746363a255f0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.225173 Aug 01 15:17:38.629020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 222/463] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:38 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:39.650339 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:39.651113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:39.658795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:39.659838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:39.660890 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:39.661567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:39.903076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:39.913726 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0ac546cc-7b06-486b-95a3-c7aaa17de89e tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.266580 Aug 01 15:17:39.915400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 242/464] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:39 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:40.612142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1585899650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-505595786", "security_groups": [{"name": "tempest-secgroup-smoke-1511582412"}], "block_device_mapping_v2": [{"uuid": "e4b16eb1-4631-4f52-b24d-94a48929a8c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b745091-6599-407e-ab8f-a04aefc65659"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:40.734549 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] validate_networks() for [('7b745091-6599-407e-ab8f-a04aefc65659', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:17:40.936123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:40.936774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:40.943723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.944174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.944959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.945396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:41.179041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:41.187080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c493d4a4-0282-4099-9a25-8a2148286125 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.254683 Aug 01 15:17:41.187770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 243/465] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:40 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:41.220432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:17:41.220973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:17:41.221667 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:17:41.222260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:17:41.222718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:17:41.232069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:41.232516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:41.233318 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:41.233754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:41.251907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for project f44ad042ba9b4bdc91783fce54774c29. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:17:41.256789 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for user c6795a827b8d411aaa165db7b38435ce and project f44ad042ba9b4bdc91783fce54774c29. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:17:41.315063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:17:41.317730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4b16eb1-4631-4f52-b24d-94a48929a8c8',volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:17:41.456058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4209406b-7e7a-4686-95d1-6f354e46f255 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.848739 Aug 01 15:17:41.456704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 223/466] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:17:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:17:41.468098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3952bac2-7e51-4a47-8f12-45612380ccd5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:41.468739 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3952bac2-7e51-4a47-8f12-45612380ccd5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:41.526833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3952bac2-7e51-4a47-8f12-45612380ccd5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:41.533648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3952bac2-7e51-4a47-8f12-45612380ccd5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1097 microversion: 2.1 time: 0.069552 Aug 01 15:17:41.534841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 244/467] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:41 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1097 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:42.209865 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:42.210507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:42.217038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.217670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:42.218777 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.219383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:42.361180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:42.369117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7bee1519-f204-4c6b-8434-b09790661602 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.164268 Aug 01 15:17:42.369736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 224/468] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:42 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:42.557575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:42.558191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:42.564698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.565146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:42.565936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.566370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:42.633228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:42.640967 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c647988c-a5a8-4b80-9973-42358d5fbbd6 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.087288 Aug 01 15:17:42.641613 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 245/469] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:42 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:43.390824 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:43.391456 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:43.398039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:43.398475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.399255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:43.399681 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.538329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:43.545905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0d57c63d-2a72-4e83-b637-fa971de24efd tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.158981 Aug 01 15:17:43.546471 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 225/470] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:43 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:43.661472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:43.662170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:43.668180 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:43.668620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.669370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:43.669798 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.735155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:43.743710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5a38a9f8-fd29-484b-8353-3c06d51d3ff2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.086093 Aug 01 15:17:43.744281 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 246/471] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:43 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:44.567607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:44.568209 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:44.574956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:44.575399 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:44.576160 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:44.576590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:44.703878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:44.712133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5fafe38a-b712-4fa7-8542-e79254315212 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.148909 Aug 01 15:17:44.712694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 226/472] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:44 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:44.764591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:44.765173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:44.771716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:44.772195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:44.772998 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:44.773430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:44.777372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:44.835673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:44.843102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f17b8d74-734d-4168-ae32-f1515a0f966a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.082407 Aug 01 15:17:44.843654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 247/473] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:44 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:45.732593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:45.733999 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:45.741701 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:45.742334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:45.743262 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:45.743772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:45.866475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:45.868725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:45.879758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:45.880646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:45.881771 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:45.882688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:45.895914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:45.904474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ae975a6b-027d-4427-b734-c906ec744f16 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.175651 Aug 01 15:17:45.919029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 227/474] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:45 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:45.978711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:45.990216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-78bd5aa4-babd-4e3e-95ac-a5192cd87220 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.128990 Aug 01 15:17:46.003684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 248/475] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:45 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:46.929130 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:46.930463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:46.938853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:46.939635 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:46.941216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:46.941923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:47.020438 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:47.021415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:47.031907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:47.033741 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:47.034073 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:47.035062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:47.135561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:47.149720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f531f174-0309-44cc-8941-7a86d4c55c83 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.136256 Aug 01 15:17:47.167671 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 249/476] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:47 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:47.171094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:47.188678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d5522420-ad83-4ec8-98a0-1b45ee4ee095 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.266471 Aug 01 15:17:47.189561 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 228/477] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:46 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:48.181467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:48.182074 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:48.188126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.188564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.189381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.190479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.209918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:48.210508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:48.217188 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.217441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.218265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.218702 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.222359 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:48.256010 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:48.263658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f49f3470-2aba-400c-90d8-646c3b500046 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.085994 Aug 01 15:17:48.264233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 250/478] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:48 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:48.364164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:48.371975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-52b64123-60c6-4a5f-8179-24842d2297ab tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.165911 Aug 01 15:17:48.372548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 229/479] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:48 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:49.284988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:49.285616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:49.291932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:49.292372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:49.293124 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:49.293551 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:49.395861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:49.397112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:49.407448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:49.408101 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:49.409305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:49.409974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:49.570278 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:49.578267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7cf8ecb4-0379-4960-a8fe-751cbcf91f45 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.297121 Aug 01 15:17:49.578862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 251/480] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:49 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:49.667661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:49.675823 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7973142-c825-42ba-82da-0431f3ffd3f6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.286114 Aug 01 15:17:49.676402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 230/481] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:49 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:50.600443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:50.601041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:50.607283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.607724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.608477 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.608909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.670816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:50.679055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e7da4bd4-2151-4b2d-9191-0b7918255f56 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.082862 Aug 01 15:17:50.679624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 252/482] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:50 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:50.696904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:50.697498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:50.704543 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.708694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.708694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.708694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.839357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:50.847336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-699dbcd1-8635-498e-9cfe-6241fe97e7a6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.154564 Aug 01 15:17:50.847901 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 231/483] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:50 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:51.702217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:51.703649 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:51.710328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:51.712373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:51.713063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:51.713998 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:51.714587 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:51.785517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:51.793805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-48a91944-116d-4e0e-805f-208bec483ba9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1147 microversion: 2.1 time: 0.097205 Aug 01 15:17:51.794757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 253/484] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:51 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1147 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:51.865984 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:51.866797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:51.871686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:51.872533 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:51.881350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:51.881990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:51.882836 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:51.883461 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:52.037596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:52.045075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a5c324a9-4b20-4abd-ba91-fd92d75c7015 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.180065 Aug 01 15:17:52.045637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 232/485] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:51 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:52.824693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:52.825958 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:52.833611 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:52.834305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:52.835403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:52.836486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:52.916363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:52.927018 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d1036334-05e2-4a19-a271-32168763828d tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1139 microversion: 2.1 time: 0.109651 Aug 01 15:17:52.931003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 254/486] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:52 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1139 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:53.065489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:53.066072 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:53.085294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:53.085742 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:53.086518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:53.086983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:53.294941 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:53.304121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c0af8813-5597-4f6e-a1d0-d936f0a4e7e9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.242468 Aug 01 15:17:53.307285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 233/487] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:53 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:53.951561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:53.952340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:53.965872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:53.966468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:53.970334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:53.972730 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:54.022415 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-109d244c-aa4c-43ee-81e5-fb825883c844 req-044b928f-df80-4fb1-b656-5befe4be845c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e33525-a6db-4813-8a29-1c5a1c5b33eb", "name": "network-vif-plugged", "status": "completed", "tag": "f47c057c-d9e2-4139-887f-aa554c5d32e5"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:54.057513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-109d244c-aa4c-43ee-81e5-fb825883c844 req-044b928f-df80-4fb1-b656-5befe4be845c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:54.063232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-109d244c-aa4c-43ee-81e5-fb825883c844 req-044b928f-df80-4fb1-b656-5befe4be845c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:54.081877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-109d244c-aa4c-43ee-81e5-fb825883c844 req-044b928f-df80-4fb1-b656-5befe4be845c service nova] Creating event network-vif-plugged:f47c057c-d9e2-4139-887f-aa554c5d32e5 for instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb on hv-cinder-84327 Aug 01 15:17:54.102192 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-109d244c-aa4c-43ee-81e5-fb825883c844 req-044b928f-df80-4fb1-b656-5befe4be845c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082585 Aug 01 15:17:54.102911 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 234/488] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:17:54.219778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:54.232875 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d962e4a2-162b-4ab6-9644-3a9d610c401f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1203 microversion: 2.1 time: 0.286246 Aug 01 15:17:54.234317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 255/489] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:53 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1203 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:54.328788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:54.329773 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:54.338059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:54.339018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:54.340081 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:54.340829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:54.680721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:54.695003 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-67556334-22e5-4f47-8b1a-4597da8b2093 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.370414 Aug 01 15:17:54.701315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 235/490] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:54 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:55.256697 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:55.257375 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:55.263853 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:55.264538 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:55.265290 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:55.265727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:55.369352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:55.380424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a584bdcb-59ca-4059-8c40-e01bd8865ac1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1213 microversion: 2.1 time: 0.128640 Aug 01 15:17:55.383004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 256/491] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:55 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:55.724284 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:55.725484 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:55.735902 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:55.736625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:55.738003 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:55.739028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:55.981190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:55.981699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:56.000721 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:56.001187 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:56.002647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:56.003106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:56.060565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:56.084101 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eaab89ed-fde1-4e09-a3b1-71fe9c5efb78 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.366530 Aug 01 15:17:56.086227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 236/492] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:55 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:56.199214 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lazy-loading 'services' on Instance uuid 4f32dc27-1309-4412-a138-b908602573dd {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:17:56.412795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:56.413534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:56.414254 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-23d5305d-4bae-4438-a0d4-b3394b90c325 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd/os-volume_attachments/fa0a1a68-98da-45ac-8172-2e940d2e8d77" status: 202 len: 0 microversion: 2.1 time: 0.435871 Aug 01 15:17:56.416022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 257/493] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:17:55 2022] DELETE /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd/os-volume_attachments/fa0a1a68-98da-45ac-8172-2e940d2e8d77 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:17:56.431448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:56.434416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:56.439608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:56.442907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:56.842070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:56.861907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a36426f9-c62b-410b-8b0e-8920fffc9d16 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.456145 Aug 01 15:17:56.864722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 237/494] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:56 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:57.111785 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:57.112609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:57.123380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.124034 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.125510 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.126320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.342315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:57.354064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5c8c2804-06c5-4122-824d-9a6c80599c95 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1374 microversion: 2.1 time: 0.246554 Aug 01 15:17:57.355166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 258/495] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:57 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:57.885878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:57.886545 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:57.895439 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.896252 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.897034 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.897790 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.254923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:58.269498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0f919852-f799-40bd-846a-a9271e066ee4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.387776 Aug 01 15:17:58.270762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 238/496] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:57 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:58.377690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:58.379574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:58.393273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.399554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.400643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.401076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.629691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:58.678842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a1e2e63d-9333-4da2-b01f-2a5006f44db6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1569 microversion: 2.1 time: 0.304793 Aug 01 15:17:58.680141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 259/497] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:58 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1569 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:58.753120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:58.753945 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:58.779056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.779810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.781496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.782157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.923376 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-46d686f7-ab02-4dd4-8fd8-5f7193c0248c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174265 Aug 01 15:17:58.927456 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 239/498] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:17:58 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:59.242573 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-6338311d-00ed-4300-90fc-8774a9366a74 req-085a914c-1b1c-4f55-ab41-6bcc83c4e282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "853a94ee-fe3a-4c55-bbd8-1b3fd6045150", "tag": "b050c354-7877-438f-8e45-4fd7ef23bdde"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:59.258100 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-6338311d-00ed-4300-90fc-8774a9366a74 req-085a914c-1b1c-4f55-ab41-6bcc83c4e282 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.269333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-6338311d-00ed-4300-90fc-8774a9366a74 req-085a914c-1b1c-4f55-ab41-6bcc83c4e282 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.282083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-6338311d-00ed-4300-90fc-8774a9366a74 req-085a914c-1b1c-4f55-ab41-6bcc83c4e282 service nova] Creating event network-changed:b050c354-7877-438f-8e45-4fd7ef23bdde for instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 on hv-cinder-84327 Aug 01 15:17:59.294496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:59.296234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:59.302392 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-6338311d-00ed-4300-90fc-8774a9366a74 req-085a914c-1b1c-4f55-ab41-6bcc83c4e282 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063151 Aug 01 15:17:59.307389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.307389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.308070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.308926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 260/499] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:59.309314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.888753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:59.889957 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:59.897896 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.898845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.899853 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.900292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.929717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:17:59.979345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:59.988016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-70c9d45d-707b-42ff-a212-1d8e379abcea tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.700085 Aug 01 15:17:59.989366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 240/500] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:17:59 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:00.031215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5774210a-23dc-4698-bc21-9a87e856a33a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 204 len: 0 microversion: 2.1 time: 0.146503 Aug 01 15:18:00.032062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 261/501] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:17:59 2022] DELETE /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:18:00.040667 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:00.041312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:00.047600 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:00.048052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:00.049425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:00.053026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:00.353695 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:00.365837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9533a97-9b74-4b8d-9f69-fb3d290afc1f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1518 microversion: 2.1 time: 0.329119 Aug 01 15:18:00.366739 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 241/502] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:00 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:00.399970 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1561398733", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:00.460931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] validate_networks() for None {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:18:00.900152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:18:00.900763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:18:00.901037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:18:00.901446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:18:00.901857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:18:00.911074 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:00.911534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:00.912343 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:00.912764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:00.920559 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:00.934572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Getting quotas for project d1bee8437e854294b8e1186391e52aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:18:00.940048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Getting quotas for user 5d2c6ceff9d74f4e8c8194f45e52dc0b and project d1bee8437e854294b8e1186391e52aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:18:00.953903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:18:00.956580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:18:01.006113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a7702eff-0815-44ea-9923-2deb7235b19b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.608927 Aug 01 15:18:01.006816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 262/503] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:18:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:18:01.013857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:01.015690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:01.019386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cb9dbffb-a35f-44bb-b74c-9a7e41fd2240 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:01.020023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-cb9dbffb-a35f-44bb-b74c-9a7e41fd2240 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:01.020496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:01.052584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.053040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.053819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.054258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.111714 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-cb9dbffb-a35f-44bb-b74c-9a7e41fd2240 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:01.118779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-cb9dbffb-a35f-44bb-b74c-9a7e41fd2240 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1219 microversion: 2.1 time: 0.104609 Aug 01 15:18:01.119359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 263/504] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:01 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:01.232768 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:01.243321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-186569b9-4d26-4f15-8cb2-ddf4887d3cbc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.235203 Aug 01 15:18:01.244864 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 242/505] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:01 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:01.327466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-23653ad2-fe91-45c5-bf38-0b81fa3d7de9 req-830b71c7-9b5b-4f75-bef4-f7f0d6c5a873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e33525-a6db-4813-8a29-1c5a1c5b33eb", "tag": "f47c057c-d9e2-4139-887f-aa554c5d32e5"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:01.338411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-23653ad2-fe91-45c5-bf38-0b81fa3d7de9 req-830b71c7-9b5b-4f75-bef4-f7f0d6c5a873 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.340471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-23653ad2-fe91-45c5-bf38-0b81fa3d7de9 req-830b71c7-9b5b-4f75-bef4-f7f0d6c5a873 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.351161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-23653ad2-fe91-45c5-bf38-0b81fa3d7de9 req-830b71c7-9b5b-4f75-bef4-f7f0d6c5a873 service nova] Creating event network-changed:f47c057c-d9e2-4139-887f-aa554c5d32e5 for instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb on hv-cinder-84327 Aug 01 15:18:01.358281 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-23653ad2-fe91-45c5-bf38-0b81fa3d7de9 req-830b71c7-9b5b-4f75-bef4-f7f0d6c5a873 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033423 Aug 01 15:18:01.358281 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 264/506] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:01.388806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:01.389421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:01.395768 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.396214 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.396988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.397426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.571722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:01.582363 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe9cc3d9-dee7-4bb6-b751-e018acf89928 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1518 microversion: 2.1 time: 0.197698 Aug 01 15:18:01.587551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 243/507] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:01 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:02.141585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:02.144370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:02.151828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.152279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.153061 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.153506 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.232475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.244080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-cde217eb-894c-4a32-8845-23042d240083 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1271 microversion: 2.1 time: 0.106761 Aug 01 15:18:02.244667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 265/508] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:02 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:02.269671 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:02.270278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:02.278786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.279475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.280465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.280906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.459706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.467654 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-76a9dbcf-b39b-43c9-8277-099ee98571dd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.202516 Aug 01 15:18:02.468238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 244/509] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:02 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:02.609145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:02.609759 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:02.616197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.616645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.617455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.617894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.758956 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.766441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-50fd7170-10e6-436b-9f25-b8aaeb0e6b53 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1518 microversion: 2.1 time: 0.161383 Aug 01 15:18:02.767053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 266/510] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:02 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:03.267265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:03.268465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:03.275068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.275695 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.276273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.276707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.339780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:03.348766 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5013fca7-7c2e-48c6-a229-6f40c2c13e39 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1271 microversion: 2.1 time: 0.085237 Aug 01 15:18:03.349613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 245/511] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:03 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:03.489597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:03.490192 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:03.493300 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:03.498800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.499263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.500056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.500491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.731787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:03.740663 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-83ae510e-ad04-4052-8871-ab1df8ea96c9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.255481 Aug 01 15:18:03.741514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 267/512] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:03 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:03.789189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:03.789722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:03.798296 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.798866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.800458 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.800972 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:04.363268 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:04.366908 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:04.372778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:04.374854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9552ad0-543f-496d-ba4c-ac16cefc8e71 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 200 len: 1518 microversion: 2.1 time: 0.589509 Aug 01 15:18:04.375327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:04.376463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 246/513] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:03 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:04.384683 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.385327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:04.386626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.387448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:04.486336 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:04.502481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-62ac0add-c66c-4484-92d6-75ad9ab6ca7e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1277 microversion: 2.1 time: 0.136588 Aug 01 15:18:04.505174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 268/514] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:04 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:04.568006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-8859b2de-540b-4030-9493-cb97c1a81568 req-e935e4d6-a2bd-42a0-bad5-ff91dfd23081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f32dc27-1309-4412-a138-b908602573dd", "name": "network-vif-deleted", "tag": "da9d9c38-6f41-4e68-8bbf-2bf2d8ed349c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:04.578054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8859b2de-540b-4030-9493-cb97c1a81568 req-e935e4d6-a2bd-42a0-bad5-ff91dfd23081 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.578493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8859b2de-540b-4030-9493-cb97c1a81568 req-e935e4d6-a2bd-42a0-bad5-ff91dfd23081 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:04.593819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-8859b2de-540b-4030-9493-cb97c1a81568 req-e935e4d6-a2bd-42a0-bad5-ff91dfd23081 service nova] Creating event network-vif-deleted:da9d9c38-6f41-4e68-8bbf-2bf2d8ed349c for instance 4f32dc27-1309-4412-a138-b908602573dd on hv-cinder-84327 Aug 01 15:18:04.601508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-8859b2de-540b-4030-9493-cb97c1a81568 req-e935e4d6-a2bd-42a0-bad5-ff91dfd23081 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037606 Aug 01 15:18:04.602493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 247/515] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:04.762578 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:04.763472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:04.773297 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.774052 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:04.774860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.775442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:05.058223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:05.069264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8714c91c-4ec7-45e5-a223-b01f9aeb1f7c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.310940 Aug 01 15:18:05.069852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 269/516] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:04 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:05.398698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:05.399434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: 4f32dc27-1309-4412-a138-b908602573dd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:05.407242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:05.408032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:05.408913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:05.409357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:05.424609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] HTTP exception thrown: Instance 4f32dc27-1309-4412-a138-b908602573dd could not be found. Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Request method failure captured: Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd HTTP/1.1 Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-4x8gtGtvVJx9P0h0x19v0wgngRqF3O3jukuPe98PRD016BnX6gzEFkQPV4cFsnm1PxlcHfEBO5uKXpgQMO4wzbH5-5kPVXKK7zILfWiU-d-7tT-kXO74XdKFwqa5Gy4lutykRfFc3TsaCAOygIDrGil7gUcy-9XAr_tTYarB8VfOA Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 060a7c219492407581c39806cc5726a3 Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotTestJSON-827375168 Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:18:05.426537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_060a7c219492407581c39806cc5726a3", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/060a7c219492407581c39806cc5726a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/060a7c219492407581c39806cc5726a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/060a7c219492407581c39806cc5726a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotTestJSON-827375168 Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 060a7c219492407581c39806cc5726a3 Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-827375168 Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotTestJSON-827375168-project Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: b507df75a6564522bf6746587d081a03 Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotTestJSON-827375168-project Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 4f32dc27-1309-4412-a138-b908602573dd could not be found. Aug 01 15:18:05.428059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '4f32dc27-1309-4412-a138-b908602573dd'} Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f32dc27-1309-4412-a138-b908602573dd could not be found. Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:05.429138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f32dc27-1309-4412-a138-b908602573dd could not be found. Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f32dc27-1309-4412-a138-b908602573dd could not be found. Aug 01 15:18:05.430426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:05.433321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Returning 404 to user: Instance 4f32dc27-1309-4412-a138-b908602573dd could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:05.433321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a9c6bcc-0dcd-418d-a973-c2d1f164ad3a tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd" status: 404 len: 111 microversion: 2.1 time: 0.034292 Aug 01 15:18:05.433321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 248/517] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:05 2022] GET /compute/v2.1/servers/4f32dc27-1309-4412-a138-b908602573dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:18:05.530458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:05.531588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:05.563247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:05.563247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:05.563247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:05.563247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:05.870772 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:05.884305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-420d29d9-b6cf-4aab-a6c1-89c6ef538e30 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.361606 Aug 01 15:18:05.885689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 270/518] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:05 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:06.092887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:06.093537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:06.101883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.102726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.104122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.104673 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.337747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:06.349738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0cbea762-8ea1-49ea-b628-163d94d4bf59 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.260577 Aug 01 15:18:06.350302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 249/519] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:06 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:06.479748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:18:06.480368 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:18:06.558969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-5440f212-2ef5-42fb-ab0f-062539fb5bc8 req-e9c09cba-6da3-47cd-9d9f-1ebb2463af14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e7bea9-e9ad-457a-b25b-14a738ef8adc", "tag": "f2a6580e-126e-45cf-bd93-4dfdd63a359e"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:06.570068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5440f212-2ef5-42fb-ab0f-062539fb5bc8 req-e9c09cba-6da3-47cd-9d9f-1ebb2463af14 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.570517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5440f212-2ef5-42fb-ab0f-062539fb5bc8 req-e9c09cba-6da3-47cd-9d9f-1ebb2463af14 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.584228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-5440f212-2ef5-42fb-ab0f-062539fb5bc8 req-e9c09cba-6da3-47cd-9d9f-1ebb2463af14 service nova] Creating event network-changed:f2a6580e-126e-45cf-bd93-4dfdd63a359e for instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc on hv-cinder-84327 Aug 01 15:18:06.589070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-5440f212-2ef5-42fb-ab0f-062539fb5bc8 req-e9c09cba-6da3-47cd-9d9f-1ebb2463af14 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035496 Aug 01 15:18:06.589969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 271/520] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:06.906422 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:06.907087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:06.914384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.914881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.916403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.916403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.051751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:07.059284 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ff00d971-81fa-4843-bb5a-709f5fc051ed tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.156695 Aug 01 15:18:07.059853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 250/521] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:06 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:07.372380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:07.373079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:07.380353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.380861 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.381714 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.382152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.518548 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:07.526364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-cbec5ea3-16a0-47bd-951d-b536cb2110f4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.158159 Aug 01 15:18:07.526994 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 272/522] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:07 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:08.082064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:08.082622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:08.089338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.089785 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.090556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.091019 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.225875 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:08.234219 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-49d4f6b7-a00a-4e81-a95d-de7b1ad66e2f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.156671 Aug 01 15:18:08.234804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 251/523] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:08 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:08.547187 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:08.547847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:08.554648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.555118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.555886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.556318 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.692007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:08.699752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-01f1be13-a3df-490c-8878-07b3abba08c5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.156373 Aug 01 15:18:08.700324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 273/524] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:08 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:09.256321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:09.256934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:09.263634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.264076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.264850 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.265288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.401726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:09.409404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-97731f83-aa13-4589-882b-718bf08d41da tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.156905 Aug 01 15:18:09.409977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 252/525] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:09 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:09.720331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:09.721549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:09.727970 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.728495 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.729323 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.729820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.867494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:09.875168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a16bb6e5-a9ec-45bb-9431-ae15cea4a44f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.158570 Aug 01 15:18:09.875917 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 274/526] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:09 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:10.429965 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:10.430570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:10.438234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.438806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.440312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.440754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.580835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:10.589827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0b9d6e48-f6ad-4c3d-b37b-376feac65e1f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.163665 Aug 01 15:18:10.590430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 253/527] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:10 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:10.897000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:10.897617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:10.903903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.904375 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.905137 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.905576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.922013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:11.052424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:11.061095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2a96aa89-37fd-4629-8db8-2ae36ba374e1 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.168066 Aug 01 15:18:11.070306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 275/528] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:10 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:11.610138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:11.610776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:11.617229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:11.617674 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:11.618434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:11.618895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:11.780990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:11.788548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a71debf0-79ca-4bb0-bf97-1d64e9117a9b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.182253 Aug 01 15:18:11.789108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 254/529] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:11 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:12.078065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=8 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:12.082919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.083530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:12.090351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:12.090837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:12.091953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:12.092387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:12.321685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:12.331331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-19bd0e57-fe79-4dc2-b8fa-6327ccf0ea7e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.253827 Aug 01 15:18:12.331918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 276/530] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:12.809128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.809673 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:12.816420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:12.816865 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:12.817617 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:12.818050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:12.955761 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:12.963415 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c728980-368d-46f8-928a-1d0078743055 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.158582 Aug 01 15:18:12.963993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 255/531] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:13.365868 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:13.366502 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:13.372713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.373163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.373935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.374373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.515076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:13.523981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fd1b8c64-62f7-401b-849e-8e387163264c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.161840 Aug 01 15:18:13.524574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 277/532] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:13 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:13.984375 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:13.984979 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:13.992622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.993032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.993809 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.994241 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:14.132665 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:14.140320 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71ba90c3-1262-4310-8460-a2a91c9e761a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.159714 Aug 01 15:18:14.140890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 256/533] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:13 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:14.545367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:14.545881 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:14.552358 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:14.552805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:14.553587 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:14.554021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:14.691513 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:14.699101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bf6c9442-e46c-4145-aa43-8bfac16c6bdb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.157677 Aug 01 15:18:14.699673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 278/534] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:14 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:15.166607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:15.167270 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:15.174339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.174874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.175774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.176230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.322922 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:15.331402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a8ce3efd-d9b2-428b-9a3b-5fbad2b7f5e0 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.170005 Aug 01 15:18:15.331973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 257/535] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:15 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:15.721341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:15.721884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:15.728135 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.728632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.729412 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.729845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.868212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:15.876188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7fe08369-e79b-485e-9635-66e717d86dbb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.159302 Aug 01 15:18:15.876938 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 279/536] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:15 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:16.352387 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:16.352992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:16.359606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.360047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.361346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.361773 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.499162 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:16.506918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5dd86d53-a464-433c-a300-550f06613695 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.158489 Aug 01 15:18:16.507659 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 258/537] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:16 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:16.898105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:16.898803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:16.904995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.905444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.906216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.906652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:17.050019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:17.057780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7e87a94d-bf65-4d41-9c3e-c75fc4d9318c tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.163536 Aug 01 15:18:17.058346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 280/538] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:16 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:17.527793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:17.528408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:17.535982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:17.536429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:17.537223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:17.537640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:17.681469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:17.689326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-37255305-a8fa-4ab5-8be9-ff905c9e469c tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.165454 Aug 01 15:18:17.689917 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 259/539] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:17 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:18.080810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:18.081427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:18.088643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:18.089095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.089866 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:18.090301 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.233663 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:18.238098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:18.242846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-05e4f169-f6c3-4860-b3c7-752eedde1560 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.166680 Aug 01 15:18:18.243440 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 281/540] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:18 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:18.710314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:18.711014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:18.717859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:18.718305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.719135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:18.719682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.863522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:18.871156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c8331f38-bd1f-4368-bfca-23be96d2b37f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.164662 Aug 01 15:18:18.871727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 260/541] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:18 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:19.264518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:19.265133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:19.271455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.271972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.272748 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.273186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.406363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:19.414606 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6546d17a-6ea7-4699-b9e7-6f497cc063fd tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.154179 Aug 01 15:18:19.415201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 282/542] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:19 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:19.896870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:19.897480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:19.904001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.904475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.905259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.905679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:20.043408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:20.051278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f40460f-eff0-4a4d-b6e4-2912622bd44a tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.158306 Aug 01 15:18:20.051859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 261/543] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:19 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:20.437726 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:20.438254 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:20.446482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:20.446957 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:20.447746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:20.448173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:20.606656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:20.623407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c04ef230-0a65-4f0d-8f5c-b789f36be649 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.189435 Aug 01 15:18:20.624211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 283/544] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:20 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:20.680383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1573589880", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "networks": [{"uuid": "c6df9827-474b-4293-bcd0-255140971e16"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:20.741475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] validate_networks() for [('c6df9827-474b-4293-bcd0-255140971e16', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:18:21.073747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:21.074268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:21.081414 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.081870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.082677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.083245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.317503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:21.325069 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7f0d281f-a0a4-4b38-89d0-b13b0bffcf0b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.255838 Aug 01 15:18:21.325568 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 284/545] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:21 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:21.432744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:18:21.433323 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:18:21.433738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:18:21.434206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:18:21.434825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:18:21.444841 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.445287 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.446108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.446522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.464429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Getting quotas for project 060a7c219492407581c39806cc5726a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:18:21.469247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Getting quotas for user b507df75a6564522bf6746587d081a03 and project 060a7c219492407581c39806cc5726a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:18:21.481590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:18:21.483881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:18:21.530872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d2950430-797e-4017-af64-7d3180c4bea7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.854359 Aug 01 15:18:21.531555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 262/546] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:18:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:18:21.543113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a77a47a2-c8b0-49ae-9f8c-982162c84be2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:21.543768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a77a47a2-c8b0-49ae-9f8c-982162c84be2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:21.608073 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a77a47a2-c8b0-49ae-9f8c-982162c84be2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:21.615431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a77a47a2-c8b0-49ae-9f8c-982162c84be2 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1223 microversion: 2.1 time: 0.076404 Aug 01 15:18:21.615998 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 285/547] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:21 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1223 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:21.645448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:21.646063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:21.652801 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.653134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.653810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.654242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.797776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:21.805490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-45d5f150-cd0b-46d0-ad11-ef6c4bfb48a9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.164346 Aug 01 15:18:21.806075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 263/548] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:21 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:22.346455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:22.347104 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:22.353190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.353637 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.354398 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.354858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.494123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:22.503656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-de9eaf1f-f449-4406-967a-32b2b9436436 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.161152 Aug 01 15:18:22.504482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 286/549] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:22 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:22.640040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:22.641308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:22.653258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-7de81af8-a9bc-499b-84be-3c7dd811c620 req-ed685726-3da7-48a6-8720-d92fea9020ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "853a94ee-fe3a-4c55-bbd8-1b3fd6045150", "name": "network-vif-plugged", "status": "completed", "tag": "b050c354-7877-438f-8e45-4fd7ef23bdde"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:22.655580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.655956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.656742 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.667546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.677665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-7de81af8-a9bc-499b-84be-3c7dd811c620 req-ed685726-3da7-48a6-8720-d92fea9020ee service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.678393 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-7de81af8-a9bc-499b-84be-3c7dd811c620 req-ed685726-3da7-48a6-8720-d92fea9020ee service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.690932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-7de81af8-a9bc-499b-84be-3c7dd811c620 req-ed685726-3da7-48a6-8720-d92fea9020ee service nova] Creating event network-vif-plugged:b050c354-7877-438f-8e45-4fd7ef23bdde for instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 on hv-cinder-84327 Aug 01 15:18:22.697204 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-7de81af8-a9bc-499b-84be-3c7dd811c620 req-ed685726-3da7-48a6-8720-d92fea9020ee service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047670 Aug 01 15:18:22.698067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 287/550] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:22.747760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:22.755844 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1407cd04-3314-4afa-af0e-d4616f4d2379 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1227 microversion: 2.1 time: 0.120039 Aug 01 15:18:22.756418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 264/551] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:22 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1227 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:22.828602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:22.829385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:22.836277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.836717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.837484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.837917 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.974803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:22.982791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e3d138d7-2e45-4d4e-a80b-8cf6c4ac790e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.159255 Aug 01 15:18:22.983355 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 288/552] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:22 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:23.525330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:23.525863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:23.532060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:23.532509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:23.533280 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:23.533717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:23.549409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:23.672273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:23.679882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-33adc6c0-7703-4e68-981e-a7e919cfd8be tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.158660 Aug 01 15:18:23.680588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 265/553] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:23 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:23.777117 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:23.778502 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:23.785871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:23.786540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:23.787737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:23.788282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:23.866511 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:23.875173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8d189e3a-1f28-48e6-b430-f18fc2a5cd98 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1227 microversion: 2.1 time: 0.102332 Aug 01 15:18:23.876613 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 289/554] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:23 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1227 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:24.007861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:24.008524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:24.015274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:24.015728 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:24.016732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:24.017341 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:24.178924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:24.190652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a7061622-3d6f-4885-8cbb-843582703dc5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.186696 Aug 01 15:18:24.191261 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 266/555] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:24 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:24.701040 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:24.701645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:24.708875 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:24.709238 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:24.710020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:24.710451 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:24.850618 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:24.858329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-976ef8d9-7429-49b2-bb7f-fe82858d9796 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.161098 Aug 01 15:18:24.858950 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 290/556] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:24 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:24.898546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:24.899210 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:24.905754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:24.906196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:24.906985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:24.907417 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:24.977229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:24.984810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c2a2e71-f8de-4324-9198-321a4096d668 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1283 microversion: 2.1 time: 0.090401 Aug 01 15:18:24.986066 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 267/557] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:24 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:25.214929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:25.215545 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:25.223311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.223897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.225184 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.225710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.374531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:25.383507 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4e5e84a4-b72d-425a-8ddf-0a1894db12ce tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.173898 Aug 01 15:18:25.384615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 291/558] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:25 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:25.880866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:25.881476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:25.888048 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.888498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.889265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.889698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.006399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:26.007029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:26.013399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.013843 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.014619 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.015091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.030281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:26.038216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c530822e-2226-4292-8354-b755eb69e5d2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.161304 Aug 01 15:18:26.039045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 268/559] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:25 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:26.085607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:26.093327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e232399a-964b-406c-9062-9bf719856db9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1281 microversion: 2.1 time: 0.090738 Aug 01 15:18:26.094203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 292/560] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:26 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:26.405071 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:26.405708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:26.411835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.412276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.413032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.413523 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.552485 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:26.560292 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3c1654c6-6ede-4e56-972d-7446ce6e92c4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1269 microversion: 2.1 time: 0.159001 Aug 01 15:18:26.560791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 269/561] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:26 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:27.059864 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:27.061133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:27.067474 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.067915 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.068681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.069281 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.114936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:27.115771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:27.122399 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.122881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.123758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.124190 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.381985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:27.399604 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8876e404-1464-4233-aedd-311dcb53b187 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.343462 Aug 01 15:18:27.404500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 293/562] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:27 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:27.428158 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:27.437254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3d349669-d586-46e2-9e34-9d7d7eb19e2b tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.326266 Aug 01 15:18:27.437845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 270/563] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:27 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:27.480952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-c285142e-4ecf-4865-b82b-d85510af14d9 req-64ef749e-c963-4dd2-9737-83d21c8a6186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e7bea9-e9ad-457a-b25b-14a738ef8adc", "name": "network-vif-plugged", "status": "completed", "tag": "f2a6580e-126e-45cf-bd93-4dfdd63a359e"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:27.494250 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-c285142e-4ecf-4865-b82b-d85510af14d9 req-64ef749e-c963-4dd2-9737-83d21c8a6186 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.494740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-c285142e-4ecf-4865-b82b-d85510af14d9 req-64ef749e-c963-4dd2-9737-83d21c8a6186 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.507740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-c285142e-4ecf-4865-b82b-d85510af14d9 req-64ef749e-c963-4dd2-9737-83d21c8a6186 service nova] Creating event network-vif-plugged:f2a6580e-126e-45cf-bd93-4dfdd63a359e for instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc on hv-cinder-84327 Aug 01 15:18:27.514078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-c285142e-4ecf-4865-b82b-d85510af14d9 req-64ef749e-c963-4dd2-9737-83d21c8a6186 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037696 Aug 01 15:18:27.514703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 294/564] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:27.582465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:27.583298 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:27.589436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.589876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.590628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.591088 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.733205 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:27.741856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9fd5a9b9-0ca3-4bc1-817a-998335d2f098 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1457 microversion: 2.1 time: 0.165280 Aug 01 15:18:27.742418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 271/565] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:27 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1457 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:27.764364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:27.765096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:27.771616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.772064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.772867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.773441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.914444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:27.922027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-59db368a-1666-4bc3-bc9b-422e6b55c5bc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1457 microversion: 2.1 time: 0.161964 Aug 01 15:18:27.923154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 295/566] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:27 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:28.423456 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:28.424042 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:28.437000 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:28.438601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:28.439451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:28.440302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:28.459096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:28.460309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:28.467484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:28.468092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:28.468879 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:28.469952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:28.945084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:28.953254 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5f880584-a75d-4da5-ab89-b21afc28a765 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.499250 Aug 01 15:18:28.955137 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 296/567] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:28 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:28.961991 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:28.970405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1a91ea6f-50f6-4e85-aa9e-ad8c0ddd8aea tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.550783 Aug 01 15:18:28.971087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 272/568] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:28 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:29.636910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-5b75afe9-4801-4090-bc82-cb7f8691168e req-43e4f4cc-1564-4d7d-b7c2-eb87589f0fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88e3ed2-07d3-424a-b966-21592fbb7588", "tag": "6f9f4df5-bde4-43b1-bea0-69e77bd0c053"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:29.646958 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5b75afe9-4801-4090-bc82-cb7f8691168e req-43e4f4cc-1564-4d7d-b7c2-eb87589f0fe6 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:29.647411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5b75afe9-4801-4090-bc82-cb7f8691168e req-43e4f4cc-1564-4d7d-b7c2-eb87589f0fe6 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:29.659347 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-5b75afe9-4801-4090-bc82-cb7f8691168e req-43e4f4cc-1564-4d7d-b7c2-eb87589f0fe6 service nova] Creating event network-changed:6f9f4df5-bde4-43b1-bea0-69e77bd0c053 for instance a88e3ed2-07d3-424a-b966-21592fbb7588 on hv-cinder-84327 Aug 01 15:18:29.664261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-5b75afe9-4801-4090-bc82-cb7f8691168e req-43e4f4cc-1564-4d7d-b7c2-eb87589f0fe6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030835 Aug 01 15:18:29.665156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 297/569] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:29.977771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:29.978709 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:29.987369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:29.987934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:29.988713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:29.989207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:29.992255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:29.993814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:30.000793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:30.001234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:30.002184 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:30.002615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:30.303974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:30.316432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c9ba2e40-9c2d-47fe-be84-f2c94310f3f9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.343405 Aug 01 15:18:30.317568 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 273/570] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:29 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:30.323275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:30.332909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b4f62cc6-95b4-4248-88a8-b283845c17ab tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.345499 Aug 01 15:18:30.344300 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 298/571] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:29 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:31.346240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:31.347020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:31.349572 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:31.355046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:31.355626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.356235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.357307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.357839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.361698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:31.370129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.372828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.373867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.374356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.454960 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:31.477238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:31.613982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:31.634646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:31.643870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8cfb9f3d-b4ae-4cc1-87b2-9878c4403849 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.301606 Aug 01 15:18:31.646856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:31.655128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 274/572] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:31 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:31.657462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dd7981a8-3465-4bc0-91a9-1878e9158f38 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1319 microversion: 2.1 time: 0.306470 Aug 01 15:18:31.659132 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 299/573] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:31 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:31.933806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-80c4daff-3d5f-4add-9b08-e9ff335baae0 req-ef47e155-2f76-417d-bccb-814724e3a054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "853a94ee-fe3a-4c55-bbd8-1b3fd6045150", "tag": "b050c354-7877-438f-8e45-4fd7ef23bdde"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:31.944620 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-80c4daff-3d5f-4add-9b08-e9ff335baae0 req-ef47e155-2f76-417d-bccb-814724e3a054 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.945057 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-80c4daff-3d5f-4add-9b08-e9ff335baae0 req-ef47e155-2f76-417d-bccb-814724e3a054 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.957697 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-80c4daff-3d5f-4add-9b08-e9ff335baae0 req-ef47e155-2f76-417d-bccb-814724e3a054 service nova] Creating event network-changed:b050c354-7877-438f-8e45-4fd7ef23bdde for instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 on hv-cinder-84327 Aug 01 15:18:31.962819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-80c4daff-3d5f-4add-9b08-e9ff335baae0 req-ef47e155-2f76-417d-bccb-814724e3a054 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032854 Aug 01 15:18:31.963408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 275/574] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:32.666129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:32.667508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:32.674624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.682408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:32.683788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:32.687457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.688625 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.689110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.698150 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.698593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.699398 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.699831 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.158813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:33.162870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:33.166545 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02e3bb08-92c8-417f-99b4-b1e38c5555af tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1468 microversion: 2.1 time: 0.490070 Aug 01 15:18:33.167150 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 276/575] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:32 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1468 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:33.171031 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0b2d4f69-fde1-4068-9a30-004c58180eb9 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.508751 Aug 01 15:18:33.171600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 300/576] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:32 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:33.218148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:33.218689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:33.225755 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:33.226210 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.227128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:33.227565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.253418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:18:33.337771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9e10ae6-30d4-43a1-a028-ca81d410fe5e tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "DELETE /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 204 len: 0 microversion: 2.1 time: 0.122651 Aug 01 15:18:33.338279 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 277/577] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:18:33 2022] DELETE /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:18:33.348468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:33.349078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:33.355935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:33.356747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.357609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:33.358055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.378871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:33.495828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:33.504045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2c86a14b-1c3c-443b-a452-e7f3c4faf20f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.161404 Aug 01 15:18:33.504588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 301/578] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:33 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:34.191744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:34.192438 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:34.199181 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:34.199619 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:34.200378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:34.200803 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:34.338757 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:34.347040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6af85063-5916-4b57-941d-570101fdf14d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.159350 Aug 01 15:18:34.347825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 278/579] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:34 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:34.525819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:34.526405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:34.528301 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=72 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:34.535022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:34.535468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:34.536240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:34.536675 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:34.669863 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:34.677706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-290d060c-b18a-4e69-aa64-ae45796f6e7f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.156098 Aug 01 15:18:34.678272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 302/580] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:34 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:35.368403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:35.369025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:35.376731 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:35.377333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:35.377949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:35.378381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:35.514101 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:35.522344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c61ff947-9236-49d1-a5ba-85613b6a6db7 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.158056 Aug 01 15:18:35.523020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 279/581] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:35 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:35.699174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:35.700009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:35.706817 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:35.707266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:35.708042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:35.708477 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:35.840556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:35.848289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6ef9ae23-163a-4ef9-8ebd-2b6e6a37b18b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.153312 Aug 01 15:18:35.848862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 303/582] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:35 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:36.543172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:36.543788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:36.550552 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.551050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:36.551830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.552262 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:36.699329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:36.707220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-baf05446-8a88-48f7-8a04-7e8b3ade17d1 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.167906 Aug 01 15:18:36.707792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 280/583] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:36 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:36.870165 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:36.870790 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:36.877861 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.878623 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:36.879423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.879850 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:37.018466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:37.026154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a7053fba-8f21-4913-92e9-e94f8088774b tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.159815 Aug 01 15:18:37.026812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 304/584] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:36 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:37.729074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:37.729637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:37.736332 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:37.736779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:37.737553 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:37.737991 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:37.740995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:37.883977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:37.892434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93d58056-51ce-407c-9c02-911db566a330 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.167252 Aug 01 15:18:37.893026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 281/585] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:37 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:38.048084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:38.048630 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:38.054910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:38.055368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:38.056138 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:38.056581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:38.194967 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:38.202641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-288e1268-0cae-4438-aea0-34bc8c8f778f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.158582 Aug 01 15:18:38.203237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 305/586] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:38 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:38.913288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:38.913931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:38.920845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:38.921340 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:38.922221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:38.922775 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:39.062191 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:39.069856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fa695ab3-fcd9-4f98-8492-4d96ab571126 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.160434 Aug 01 15:18:39.070425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 282/587] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:38 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:39.223926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:39.224865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:39.231326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:39.231768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:39.232536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:39.232969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:39.372270 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:39.381235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f06c790d-5fa6-46f2-a137-fe9731f74a4d tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.160678 Aug 01 15:18:39.381835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 306/588] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:39 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:40.091577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:40.092185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:40.099351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.099787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.100546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.100971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.238224 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:40.246236 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af68a7ec-27f8-4127-b14c-61d5001a4a82 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.158447 Aug 01 15:18:40.247039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 283/589] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:40 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:40.403068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:40.403654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:40.411494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.411940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.413316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.414098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.549597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:40.557329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-192be50b-ffe8-43c1-ab15-cbee8f427b08 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.158099 Aug 01 15:18:40.557910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 307/590] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:40 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:41.267983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:41.268566 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:41.275834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:41.276283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:41.277058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:41.277521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:41.415756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:41.423251 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fc47602-e9e3-4a76-9b4f-bef9a510b1ea tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.159849 Aug 01 15:18:41.423814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 284/591] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:41 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:41.579088 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:41.580021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:41.586159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:41.586625 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:41.587413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:41.587837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:41.721902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:41.729607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-90317d8a-0562-45b0-9575-bcbae503ab52 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.155041 Aug 01 15:18:41.730177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 308/592] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:41 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:42.446015 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:42.446573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:42.453303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:42.453755 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:42.454831 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:42.455270 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:42.592489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:42.600041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e5fbde66-eeaf-48ed-bf95-53e43b6e35e8 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.158614 Aug 01 15:18:42.600610 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 285/593] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:42 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:42.752556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:42.753123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:42.759211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:42.759638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:42.760401 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:42.760832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:42.896680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:42.904276 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3701cb5c-c0e1-4f01-aecd-e0d1d983c9b4 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.155812 Aug 01 15:18:42.904841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 309/594] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:42 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:43.621778 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:43.622384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:43.629821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:43.630261 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:43.631076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:43.631495 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:43.772989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:43.780537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f52baa7e-18e9-4ae0-9217-927f75bbb1e4 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.162636 Aug 01 15:18:43.781615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 286/595] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:43 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:43.926456 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:43.927091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:43.933596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:43.934047 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:43.934845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:43.935280 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:44.068964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:44.076729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2da1b827-e909-474c-83dc-cf0efb62773f tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.154854 Aug 01 15:18:44.077304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 310/596] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:43 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:44.801975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:44.802521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:44.809286 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:44.809734 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:44.810522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:44.810998 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:44.944257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:44.951808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d4975ed6-bbda-4553-aec8-2c57c7f98317 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.153771 Aug 01 15:18:44.952373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 287/597] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:44 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:45.099277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:45.099880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:45.106506 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:45.106995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:45.107757 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:45.108188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:45.248147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:45.255865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7dcf54d3-60fe-46ef-a3c6-09ebfef04b80 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.160617 Aug 01 15:18:45.256449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 311/598] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:45 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:45.973016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:45.973622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:45.980267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:45.980716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:45.981487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:45.981920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:46.120113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:46.128111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71f8b784-0ffc-4318-b70c-46da7fb92b0d tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.159389 Aug 01 15:18:46.128612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 288/599] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:45 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:46.276934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:46.277675 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:46.284438 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:46.284981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:46.285864 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:46.286304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:46.424674 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:46.432371 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-20d9a83b-de54-4ead-a7fb-365a341ce435 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1474 microversion: 2.1 time: 0.159814 Aug 01 15:18:46.432945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 312/600] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:46 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:47.149301 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:47.149910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:47.158416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:47.158746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:47.159503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:47.159955 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:47.231706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-887ebe93-f6d2-426a-9876-b537958deb6b req-a8c7d4d1-8313-49ed-a103-bb1f192d4823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e7bea9-e9ad-457a-b25b-14a738ef8adc", "name": "network-vif-deleted", "tag": "f2a6580e-126e-45cf-bd93-4dfdd63a359e"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:47.244126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-887ebe93-f6d2-426a-9876-b537958deb6b req-a8c7d4d1-8313-49ed-a103-bb1f192d4823 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:47.244736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-887ebe93-f6d2-426a-9876-b537958deb6b req-a8c7d4d1-8313-49ed-a103-bb1f192d4823 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:47.258777 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-887ebe93-f6d2-426a-9876-b537958deb6b req-a8c7d4d1-8313-49ed-a103-bb1f192d4823 service nova] Creating event network-vif-deleted:f2a6580e-126e-45cf-bd93-4dfdd63a359e for instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc on hv-cinder-84327 Aug 01 15:18:47.264957 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-887ebe93-f6d2-426a-9876-b537958deb6b req-a8c7d4d1-8313-49ed-a103-bb1f192d4823 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036750 Aug 01 15:18:47.265649 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 313/601] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:47.336211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:47.344791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1142761f-c8cb-492e-bf38-919b03773f5c tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.199367 Aug 01 15:18:47.345576 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 289/602] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:47 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:47.454048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:47.454953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:47.461173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:47.461612 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:47.462362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:47.462896 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:47.495576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:47.496024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:47.496453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lazy-loading 'fault' on Instance uuid b9e7bea9-e9ad-457a-b25b-14a738ef8adc {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:47.539824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2c6ceff9d74f4e8c8194f45e52dc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bee8437e854294b8e1186391e52aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:47.548946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d9783a94-7154-4736-9ec5-1722a9338a23 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 200 len: 1309 microversion: 2.1 time: 0.099101 Aug 01 15:18:47.549526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 314/603] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:47 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:48.337373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-af496f04-4292-4216-a15c-fc45bf8bcdef req-a370a1b9-aba2-455a-9032-2667e2081e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88e3ed2-07d3-424a-b966-21592fbb7588", "name": "network-vif-plugged", "status": "completed", "tag": "6f9f4df5-bde4-43b1-bea0-69e77bd0c053"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:48.347985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-af496f04-4292-4216-a15c-fc45bf8bcdef req-a370a1b9-aba2-455a-9032-2667e2081e13 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:48.348204 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-af496f04-4292-4216-a15c-fc45bf8bcdef req-a370a1b9-aba2-455a-9032-2667e2081e13 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:48.360876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-af496f04-4292-4216-a15c-fc45bf8bcdef req-a370a1b9-aba2-455a-9032-2667e2081e13 service nova] Creating event network-vif-plugged:6f9f4df5-bde4-43b1-bea0-69e77bd0c053 for instance a88e3ed2-07d3-424a-b966-21592fbb7588 on hv-cinder-84327 Aug 01 15:18:48.366579 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-af496f04-4292-4216-a15c-fc45bf8bcdef req-a370a1b9-aba2-455a-9032-2667e2081e13 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034230 Aug 01 15:18:48.367228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:48.367570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 290/604] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:48.368574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:48.377815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:48.378326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:48.379209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:48.379647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:48.522717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:48.531425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-004f9f01-13b6-4b2b-b0c0-91a74a5535ef tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.169680 Aug 01 15:18:48.532052 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 315/605] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:48 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:48.570027 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:48.570757 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] [instance: b9e7bea9-e9ad-457a-b25b-14a738ef8adc] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:48.577173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:48.577617 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:48.579037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:48.579723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:48.593817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] HTTP exception thrown: Instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc could not be found. Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Request method failure captured: Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc HTTP/1.1 Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-6lLIQabT_nYd1qKsqPdxGw8woo8Jtm5ux1Jm8oGqT7oD_sEwDryohZOTCsILpA6hKroWDc7tQduzzNY1UsGV580Kv4BpL8lOT48ng5K8CPCAcGAaW2rlhD1EczEEoVCYzXj_WX7D3dXf_NWYARuNASphZdB_KCHiodTwG9SIz94jI Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: d1bee8437e854294b8e1186391e52aa6 Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-526312871 Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:18:48.595510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_d1bee8437e854294b8e1186391e52aa6", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/d1bee8437e854294b8e1186391e52aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/d1bee8437e854294b8e1186391e52aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/d1bee8437e854294b8e1186391e52aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-526312871 Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: d1bee8437e854294b8e1186391e52aa6 Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-526312871 Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-526312871-project Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 5d2c6ceff9d74f4e8c8194f45e52dc0b Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-526312871-project Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc could not be found. Aug 01 15:18:48.597135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'b9e7bea9-e9ad-457a-b25b-14a738ef8adc'} Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc could not be found. Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:48.598100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc could not be found. Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc could not be found. Aug 01 15:18:48.599625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:18:48.600905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] Returning 404 to user: Instance b9e7bea9-e9ad-457a-b25b-14a738ef8adc could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:48.600905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0d7afa60-968b-4872-9cb7-b49263f692f2 tempest-VolumesNegativeTest-526312871 tempest-VolumesNegativeTest-526312871-project] 10.222.0.100 "GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc" status: 404 len: 111 microversion: 2.1 time: 0.031244 Aug 01 15:18:48.600905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 291/606] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:48 2022] GET /compute/v2.1/servers/b9e7bea9-e9ad-457a-b25b-14a738ef8adc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:18:49.552670 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:49.553278 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:49.560259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:49.560707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:49.561822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:49.562897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:49.720957 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:49.730684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5bf33c4d-adba-4d40-8ab9-83cbf8e1e343 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.181696 Aug 01 15:18:49.731322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 316/607] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:49 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:50.751872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:50.752521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:50.759352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:50.760987 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:50.761799 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:50.762248 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:50.914969 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:50.922529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-25a2e908-59c3-4552-8201-66890009cf9f tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.174735 Aug 01 15:18:50.923134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 292/608] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:50 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:51.943536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:51.944183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:51.950628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:51.951105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:51.951880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:51.952335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:52.089925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:52.099586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ec6280d5-ad27-4e53-873b-9aee3ef02854 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1323 microversion: 2.1 time: 0.159783 Aug 01 15:18:52.100185 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 317/609] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:51 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:53.120970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:53.121608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:53.136324 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:53.136776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:53.137551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:53.137990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:53.280590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:53.290434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4e0010e-f92b-4110-9172-d70ff4264aeb tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1512 microversion: 2.1 time: 0.173280 Aug 01 15:18:53.300940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 293/610] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:18:53 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:53.313152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430e9390-0362-49a3-bf36-7951fed8ec20", "device": "/dev/sdb"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:53.316351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:53.323354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:53.323798 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:53.324581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:53.325010 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:53.343922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:53.693181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-45050f5c-afa1-4280-8998-45185013f97e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "POST /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384490 Aug 01 15:18:53.694024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 318/611] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:18:53 2022] POST /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:22.519582 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:22.520182 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:22.522544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:22.523465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=69 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:22.529650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:22.530111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:22.534971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:22.535448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:22.694300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lazy-loading 'services' on Instance uuid a88e3ed2-07d3-424a-b966-21592fbb7588 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:19:22.821411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5517d20e-fc05-421a-b3a5-3ea8893c4f55 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588/os-volume_attachments/430e9390-0362-49a3-bf36-7951fed8ec20" status: 202 len: 0 microversion: 2.1 time: 0.305185 Aug 01 15:19:22.825995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 294/612] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:19:22 2022] DELETE /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588/os-volume_attachments/430e9390-0362-49a3-bf36-7951fed8ec20 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:19:25.095094 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:25.096783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:25.099135 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=35 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:25.099902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:25.107590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.108055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.108914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.109356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.141141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:19:25.254943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5b91237e-6ca5-4f6b-b940-750d1401d453 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 204 len: 0 microversion: 2.1 time: 0.164210 Aug 01 15:19:25.255695 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 319/613] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:19:25 2022] DELETE /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:19:25.269542 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:25.271990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:25.281471 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.281924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.283188 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.283812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.520314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:25.528386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-112e592c-e8cc-4cf6-924d-222dedea8931 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1518 microversion: 2.1 time: 0.265853 Aug 01 15:19:25.539173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 295/614] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:25 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:26.550424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:26.551171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:26.558137 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:26.559038 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:26.563127 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:26.563887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:26.777344 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:26.787900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-34227cba-3b22-4c59-8003-7c500703f3ba tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1518 microversion: 2.1 time: 0.241611 Aug 01 15:19:26.789827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 320/615] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:26 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1518 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:27.809943 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:27.815303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:27.824025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.824802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.833430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.834305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:28.477713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-c510b9bb-f90d-4d6e-9b05-f6b576810abc req-89e26412-f41d-46de-9579-0e9240d19832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88e3ed2-07d3-424a-b966-21592fbb7588", "name": "network-vif-deleted", "tag": "6f9f4df5-bde4-43b1-bea0-69e77bd0c053"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:28.488692 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b507df75a6564522bf6746587d081a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060a7c219492407581c39806cc5726a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:28.494934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-c510b9bb-f90d-4d6e-9b05-f6b576810abc req-89e26412-f41d-46de-9579-0e9240d19832 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:28.495657 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-c510b9bb-f90d-4d6e-9b05-f6b576810abc req-89e26412-f41d-46de-9579-0e9240d19832 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:28.506073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7890cc2c-f032-4b5d-9f21-d44ea6f71c9e tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 200 len: 1476 microversion: 2.1 time: 0.700249 Aug 01 15:19:28.518687 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 296/616] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:27 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 1476 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:28.527574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-c510b9bb-f90d-4d6e-9b05-f6b576810abc req-89e26412-f41d-46de-9579-0e9240d19832 service nova] Creating event network-vif-deleted:6f9f4df5-bde4-43b1-bea0-69e77bd0c053 for instance a88e3ed2-07d3-424a-b966-21592fbb7588 on hv-cinder-84327 Aug 01 15:19:28.533805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-c510b9bb-f90d-4d6e-9b05-f6b576810abc req-89e26412-f41d-46de-9579-0e9240d19832 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060004 Aug 01 15:19:28.548420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 321/617] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:19:29.531309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:29.532556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] [instance: a88e3ed2-07d3-424a-b966-21592fbb7588] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:29.549861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.550396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.551299 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.552555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.568064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] HTTP exception thrown: Instance a88e3ed2-07d3-424a-b966-21592fbb7588 could not be found. Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Request method failure captured: Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 HTTP/1.1 Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-4x8gtGtvVJx9P0h0x19v0wgngRqF3O3jukuPe98PRD016BnX6gzEFkQPV4cFsnm1PxlcHfEBO5uKXpgQMO4wzbH5-5kPVXKK7zILfWiU-d-7tT-kXO74XdKFwqa5Gy4lutykRfFc3TsaCAOygIDrGil7gUcy-9XAr_tTYarB8VfOA Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 060a7c219492407581c39806cc5726a3 Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotTestJSON-827375168 Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:19:29.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_060a7c219492407581c39806cc5726a3", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/060a7c219492407581c39806cc5726a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/060a7c219492407581c39806cc5726a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/060a7c219492407581c39806cc5726a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotTestJSON-827375168 Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 060a7c219492407581c39806cc5726a3 Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-827375168 Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotTestJSON-827375168-project Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: b507df75a6564522bf6746587d081a03 Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotTestJSON-827375168-project Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance a88e3ed2-07d3-424a-b966-21592fbb7588 could not be found. Aug 01 15:19:29.571416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'a88e3ed2-07d3-424a-b966-21592fbb7588'} Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88e3ed2-07d3-424a-b966-21592fbb7588 could not be found. Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:29.572517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88e3ed2-07d3-424a-b966-21592fbb7588 could not be found. Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88e3ed2-07d3-424a-b966-21592fbb7588 could not be found. Aug 01 15:19:29.574628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:19:29.576707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] Returning 404 to user: Instance a88e3ed2-07d3-424a-b966-21592fbb7588 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:29.578247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2851a1cf-f881-4867-8598-23c3b11b4906 tempest-VolumesSnapshotTestJSON-827375168 tempest-VolumesSnapshotTestJSON-827375168-project] 10.222.0.100 "GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588" status: 404 len: 111 microversion: 2.1 time: 0.051170 Aug 01 15:19:29.579509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 297/618] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:29 2022] GET /compute/v2.1/servers/a88e3ed2-07d3-424a-b966-21592fbb7588 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:19:38.362619 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:38.365119 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:38.374186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:38.374644 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:38.375455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:38.376009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:38.517710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6413ec23-af7f-45cd-a5f4-0db50daba687 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action" status: 200 len: 29147 microversion: 2.1 time: 0.159764 Aug 01 15:19:38.518648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 322/619] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:19:38 2022] POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action => generated 29147 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:19:40.049423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-835ce7ab-5adc-4c2c-b3c3-bab1647f101d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Action: 'create', calling method: .version_select at 0x7efd1d209f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1253813154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGR5cGc1bIxn444hAv4XQiw4hY/nasBnbG31QJKJi++I5NdSptS+olBsrZlncSa+x0bqeTXuUbgbH69wZglywUL8KLBxlXYcdkHTu7MoWFtasbpSDS/e01Q/dYkecp6aA=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:40.055206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=8 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:40.056335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:40.069772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-835ce7ab-5adc-4c2c-b3c3-bab1647f101d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Getting quotas for project f9c87c7cbcb5481db04aaa2a494be32d. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:19:40.073754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-835ce7ab-5adc-4c2c-b3c3-bab1647f101d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Getting quotas for user c95c223146c94cd29850744a208ed60d and project f9c87c7cbcb5481db04aaa2a494be32d. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:19:40.101973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-835ce7ab-5adc-4c2c-b3c3-bab1647f101d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056772 Aug 01 15:19:40.102818 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 298/620] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:19:40 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:40.154530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1552439246", "imageRef": "4c5869ec-8fd8-4269-ae67-0aacce87fa7a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1253813154", "networks": [{"uuid": "1e682ad2-8b32-4e3d-ba92-108f4abc4f77"}]}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:40.269402 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] validate_networks() for [('1e682ad2-8b32-4e3d-ba92-108f4abc4f77', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:19:40.665077 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:19:40.665514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:19:40.665991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:19:40.666494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:19:40.666931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:19:40.676934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.677450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.678199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.678635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.696372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Getting quotas for project f9c87c7cbcb5481db04aaa2a494be32d. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:19:40.700253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Getting quotas for user c95c223146c94cd29850744a208ed60d and project f9c87c7cbcb5481db04aaa2a494be32d. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:19:40.712152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:19:40.714425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c5869ec-8fd8-4269-ae67-0aacce87fa7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:19:40.759485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bda35991-8ef6-45bd-b031-76f5725cbaf3 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.609125 Aug 01 15:19:40.760144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 323/621] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:19:40 2022] POST /compute/v2.1/servers => generated 382 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:19:40.770834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6665ace4-3157-4bcb-b195-1df09f82b279 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:40.771587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6665ace4-3157-4bcb-b195-1df09f82b279 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:40.827628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6665ace4-3157-4bcb-b195-1df09f82b279 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:40.835754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6665ace4-3157-4bcb-b195-1df09f82b279 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1263 microversion: 2.1 time: 0.068832 Aug 01 15:19:40.836336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 299/622] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:40 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:41.856544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:41.857209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:41.866684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:41.867152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:41.867923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:41.868360 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:41.937601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:41.945364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-de2518ec-df8d-486f-b7f2-64dbebeb5124 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1315 microversion: 2.1 time: 0.093179 Aug 01 15:19:41.945962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 324/623] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:41 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:42.968602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:42.969227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:42.976190 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:42.976633 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:42.981506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:42.982531 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:43.162223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:43.170198 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ccd704ea-abeb-4c84-b691-3ced24912aff tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.205393 Aug 01 15:19:43.170982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 300/624] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:42 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:44.194079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:44.194939 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:44.205465 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:44.206137 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:44.207370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:44.208047 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:44.370979 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:44.379370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-94b9035f-4ebb-434a-814e-72eb514e6ed1 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.191504 Aug 01 15:19:44.380035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 325/625] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:44 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:44.845417 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:44.846069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:44.852942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:44.853391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:44.854160 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:44.854678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:44.879218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40a975ee-e250-441b-b94d-4e0a15d1b160 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/ips" status: 200 len: 153 microversion: 2.20 time: 0.037604 Aug 01 15:19:44.879786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 301/626] 10.222.0.100 () {60 vars in 1294 bytes} [Mon Aug 1 15:19:44 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:19:45.407460 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:45.409636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:45.420129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:45.421166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:45.422462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:45.423228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:45.596210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:45.604479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-87a1fd07-d5a6-4afd-a8a7-18d63f125ac8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.206437 Aug 01 15:19:45.605089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 326/627] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:45 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:46.626838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:46.627511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:46.634002 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:46.634453 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:46.635257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:46.635698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:46.833602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:46.843973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9b7f5d79-9375-46d9-81a9-2fad38362601 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.221521 Aug 01 15:19:46.858910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 302/628] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:46 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:47.867295 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:47.867928 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:47.877005 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:47.877461 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:47.878262 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:47.878727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:48.013192 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:48.020771 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-19927c53-5881-4646-908a-bf4b9d2ecb9f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.157501 Aug 01 15:19:48.021357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 327/629] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:47 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:49.043729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:49.045142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:49.054070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.054884 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.055881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.056513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.209676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:49.217854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4b4d6f21-6c65-44e9-a8f2-d10014c50980 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.179043 Aug 01 15:19:49.218478 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 303/630] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:49 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:49.643934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:49.644485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:49.650577 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.651058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.651821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.652259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.675296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-02265c8d-d67f-4edb-93a8-faa5942145e0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/ips" status: 200 len: 144 microversion: 2.1 time: 0.149751 Aug 01 15:19:49.675851 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 328/631] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:19:49 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/ips => generated 144 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:50.241699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:50.242297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:50.249523 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:50.249969 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:50.250766 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:50.251202 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:50.394288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:50.401737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0f9b48cd-a235-46bf-b012-6fbc36cf6d6a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.163976 Aug 01 15:19:50.402304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 304/632] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:50 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:51.423111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:51.423761 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:51.426196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:51.426968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:51.433885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:51.434338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:51.435992 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:51.436443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:51.567381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:51.574712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2da7a1f6-108c-4c8f-a41b-b442fc5eef95 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.155552 Aug 01 15:19:51.575491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 329/633] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:51 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:52.609049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:52.609661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:52.617642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:52.625494 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:52.626607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:52.627627 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:52.628271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:52.769082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:52.777028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5028f93b-ba75-4e8b-a899-9dd58bb1ba3a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.176287 Aug 01 15:19:52.777769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 305/634] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:52 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:53.276448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:53.277068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:53.284042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.284491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.285520 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.286278 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.309672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lazy-loading 'flavor' on Instance uuid 50052019-4694-4875-8915-9392814a8aba {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:19:53.510833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b34df76f-310f-4c02-9bcf-318596925771 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/action" status: 202 len: 0 microversion: 2.20 time: 0.238208 Aug 01 15:19:53.511424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 330/635] 10.222.0.100 () {62 vars in 1324 bytes} [Mon Aug 1 15:19:53 2022] POST /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:19:53.519751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:53.520362 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:53.526682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.527142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.527899 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.528354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.693524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.701606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.703164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.704596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4fda1ff0-454a-4851-aa06-603f1d9fb982 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.188801 Aug 01 15:19:53.705150 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 306/636] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:19:53 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:53.799531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:53.800698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:53.807787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.808216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.809170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.809616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.953013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.961048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7e7b39cc-c452-44a1-b0fc-4429d7e5710a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.166930 Aug 01 15:19:53.961809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 331/637] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:53 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:53.987513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78c40bf4-2d99-4815-9dab-2122bb4495aa"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:53.989922 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:53.996003 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.996451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.997249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.997697 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.728640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:54.729256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:54.736326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.736773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.737577 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.737986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.913602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:54.925836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:54.927481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:54.929833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ae1c7f84-c363-4cef-9b35-7425359de707 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.205107 Aug 01 15:19:54.930718 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 332/638] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:19:54 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:54.984128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:54.984615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:54.991920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.992434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.993240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.994045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:55.139487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:55.143112 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:55.148954 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7da3b50c-b2f2-4022-b50a-cc521a3c8997 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.169870 Aug 01 15:19:55.149518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 333/639] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:54 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:55.957666 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:55.958385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:55.961164 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:55.967845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:55.968286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:55.969046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:55.969504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:56.158574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.170486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.172022 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.173212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-16eb5745-0895-48a8-b3d3-f41ad2e3749a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.219721 Aug 01 15:19:56.174085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 334/640] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:19:55 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:56.179365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:56.179990 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:56.186192 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:56.186573 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:56.187374 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:56.187810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:56.357382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.366601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-349a485a-e640-4061-a46a-c2293fe53075 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.191270 Aug 01 15:19:56.367244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 335/641] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:56 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:57.197338 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:57.197919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:57.204710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.205166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.205942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.206382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.366753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.375594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.377499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.378945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-df855098-444c-418e-baa1-160e9b6ba6b4 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.185492 Aug 01 15:19:57.379500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 336/642] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:19:57 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:57.388423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:57.389319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:57.397304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.398114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.399500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.400210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.558213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.568753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c43d8d2e-88cb-42ee-b7d4-5d0974149f0d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.182390 Aug 01 15:19:57.568753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 337/643] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:57 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:58.405269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:58.407046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:58.414004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.414446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.415236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.415667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.567796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.580235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.581768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.582960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a780ffad-302e-4b66-8ca2-39df7b3e4d2e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.181907 Aug 01 15:19:58.583513 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 338/644] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:19:58 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:58.589066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:58.589761 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:58.595990 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.596535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.597366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.597870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.739316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.746777 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-da57554f-c12a-4491-a9c7-22394e7fe21f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.161162 Aug 01 15:19:58.747379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 339/645] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:58 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:59.607688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:59.608352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:59.614940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:59.615388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:59.616158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:59.616595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:59.762015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:59.772182 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:59.773677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:59.774860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2bf73e75-f554-4b5e-9c28-fee995684f79 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.172191 Aug 01 15:19:59.775408 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 340/646] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:19:59 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:59.780365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:59.780953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:59.788220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:59.788220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:59.789063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:59.789491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:59.943239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:59.951978 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f7272d2b-c22b-4fdd-963c-1018001b3c49 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.174968 Aug 01 15:19:59.952638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 341/647] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:19:59 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:00.800287 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:00.801539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:00.809216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:00.809909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:00.811959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:00.812242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:00.964647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:00.973046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:00.974554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:00.975796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6f44906c-5f11-4c78-be9b-d77fe0443846 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.180350 Aug 01 15:20:00.976349 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 342/648] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:00 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:00.980831 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:00.981519 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:00.987609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:00.988059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:00.988822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:00.989256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:01.127105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:01.135672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-66e64d60-dbe1-4abc-95ee-83876c9a412f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.158131 Aug 01 15:20:01.136262 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 343/649] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:00 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:01.602415 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-47f525fb-a729-49ff-b2e9-92ba7b2bbd09 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.618517 Aug 01 15:20:01.608857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 307/650] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:19:53 2022] POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-volume_attachments => generated 194 bytes in 7626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:01.999859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:02.000553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:02.007788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.008529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.009492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.009926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.084446 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-42e2a718-ec6a-4540-a504-05bbfd3c537b req-e6f68fb8-66cf-4949-a70d-03664f144f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:02.102336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-42e2a718-ec6a-4540-a504-05bbfd3c537b req-e6f68fb8-66cf-4949-a70d-03664f144f97 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.103058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-42e2a718-ec6a-4540-a504-05bbfd3c537b req-e6f68fb8-66cf-4949-a70d-03664f144f97 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.118597 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-42e2a718-ec6a-4540-a504-05bbfd3c537b req-e6f68fb8-66cf-4949-a70d-03664f144f97 service nova] Creating event network-changed:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:20:02.123798 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-42e2a718-ec6a-4540-a504-05bbfd3c537b req-e6f68fb8-66cf-4949-a70d-03664f144f97 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048287 Aug 01 15:20:02.124410 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 308/651] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:02.160672 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:02.161382 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:02.167952 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.168415 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.169309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.169754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.172375 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:02.180842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:02.182346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:02.183563 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-022f2a84-8f46-4c71-a7ba-a632f449ebfe tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.187603 Aug 01 15:20:02.184116 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 344/652] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:01 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:02.315772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:02.324522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0cd2a137-9607-4fb3-87ab-2c83a7cc2428 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.169530 Aug 01 15:20:02.324522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 309/653] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:02 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:03.208650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:03.209388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:03.216699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:03.217157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:03.217926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:03.220913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:03.345438 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:03.346178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:03.353642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:03.354201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:03.355086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:03.355598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:03.462170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:03.471318 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:03.472825 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:03.474000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4afc62db-128f-4faa-8ec0-8c43575b1fc2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.269811 Aug 01 15:20:03.474565 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 345/654] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:03 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:03.604199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:03.611858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7bd9be00-f9a0-479b-919c-8e636af98e4c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.270915 Aug 01 15:20:03.612429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 310/655] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:03 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:04.498622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:04.499550 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:04.506318 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:04.506702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:04.508616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:04.509076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:04.636835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:04.637422 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:04.644533 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:04.644973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:04.645740 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:04.646175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:04.663913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:04.672100 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:04.673584 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:04.674842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e3419423-1edf-43de-ba06-8ddbee00a29e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.181016 Aug 01 15:20:04.675445 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 346/656] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:04 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:04.784705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:04.792124 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05977e1d-dc50-4bbe-a55a-cd54a60e5d51 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.159200 Aug 01 15:20:04.792692 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 311/657] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:04 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:05.698373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:05.699006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:05.705852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:05.706296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:05.707097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:05.707526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:05.812897 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:05.813532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:05.820117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:05.820559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:05.821328 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:05.821758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:05.842321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:05.850560 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:05.852094 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:05.853282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5bdff229-20cc-424a-919e-e24393e7c0c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.158860 Aug 01 15:20:05.853844 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 347/658] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:05 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:05.958870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:05.966988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b97869bd-296d-4dee-b585-3cba916f1947 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.158066 Aug 01 15:20:05.967566 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 312/659] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:05 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:06.878320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:06.878951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:06.885752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:06.886210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:06.887027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:06.887494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:06.992394 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:06.993071 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:07.001308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:07.002107 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:07.003406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:07.004138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:07.064739 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:07.073328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:07.074827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:07.076020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-30ec6293-7be8-4bd3-9685-d3155fcb3976 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.203484 Aug 01 15:20:07.076573 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 348/660] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:06 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:07.154324 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:07.165572 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0af992dc-77ae-4617-be9a-0c4ecc5098af tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.177290 Aug 01 15:20:07.166177 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 313/661] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:06 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:08.109199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:08.109800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:08.116780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:08.117229 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:08.117997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:08.118431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:08.188033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:08.188730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:08.195670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:08.196123 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:08.196948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:08.197425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:08.264628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:08.273217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:08.274737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:08.275964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-193773ed-6392-4643-bdef-fe14c1fbc0a7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.171174 Aug 01 15:20:08.276515 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 349/662] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:08 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:08.359459 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:08.366861 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02d33e33-f580-4f3d-85e4-1cea59e795e6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.183539 Aug 01 15:20:08.367432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 314/663] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:08 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:09.299436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:09.300042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:09.306939 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.307389 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.308173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.308614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.330180 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:09.388890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:09.389744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:09.402157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.402607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.403509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.403969 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.462763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:09.471190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:09.472699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:09.474093 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a01609e4-2611-4ada-9246-aba26413d643 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.178741 Aug 01 15:20:09.474676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 350/664] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:09 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:09.563016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:09.573430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-63a11db3-2c6b-4ffb-8284-1552e898acb8 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.188124 Aug 01 15:20:09.574024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 315/665] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:09 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:10.272655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d5377d56-cc1f-4c7a-beaa-9115f7c5dbbd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:10.279379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d5377d56-cc1f-4c7a-beaa-9115f7c5dbbd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.279832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d5377d56-cc1f-4c7a-beaa-9115f7c5dbbd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.344189 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d5377d56-cc1f-4c7a-beaa-9115f7c5dbbd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Going to try to stop instance {{(pid=117887) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:20:10.389441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d5377d56-cc1f-4c7a-beaa-9115f7c5dbbd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.120453 Aug 01 15:20:10.390041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 351/666] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:20:10 2022] POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:20:10.399696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:10.400313 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:10.402839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:10.408978 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.409501 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.410404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.410983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.417369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:10.499591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:10.499591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:10.515108 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.516174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.517320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.518004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.570843 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.579929 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-466cb259-6409-4bf1-a6db-287284de0a08 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.185508 Aug 01 15:20:10.580515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 316/667] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:10 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:10.597068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:10.597792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:10.603959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.604493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.605314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.605812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.706746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.715245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.716734 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.717925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9de12c3a-9c94-4965-9375-46c2c0914e5e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.223908 Aug 01 15:20:10.718483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 352/668] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:10 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:10.765810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.773577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cd3f365d-7d2c-4b7c-9c21-0baaa4d16c2e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.183137 Aug 01 15:20:10.774453 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 317/669] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:10 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:10.998430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-d6bffc79-4809-4f50-970b-7e9eb85952ce req-d2bc1817-b275-46ca-8433-8ae60ec0de1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "name": "network-vif-plugged", "status": "completed", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:11.008035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d6bffc79-4809-4f50-970b-7e9eb85952ce req-d2bc1817-b275-46ca-8433-8ae60ec0de1a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.008499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d6bffc79-4809-4f50-970b-7e9eb85952ce req-d2bc1817-b275-46ca-8433-8ae60ec0de1a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.020871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-d6bffc79-4809-4f50-970b-7e9eb85952ce req-d2bc1817-b275-46ca-8433-8ae60ec0de1a service nova] Creating event network-vif-plugged:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:20:11.025614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-d6bffc79-4809-4f50-970b-7e9eb85952ce req-d2bc1817-b275-46ca-8433-8ae60ec0de1a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 Aug 01 15:20:11.026208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 353/670] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:11.602038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:11.602647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:11.609780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.610228 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.611038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.611476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.742393 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:11.743170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:11.747442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.749650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.750135 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.750947 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.751381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.764760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec2be6c6-4e5f-466c-9888-862a99cf52ef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.166536 Aug 01 15:20:11.765345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 318/671] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:11 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:11.793556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:11.794858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:11.801117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.802175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.802983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.803429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.939896 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.952154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.955077 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.957198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5c1bd688-1e71-489c-bf5c-bf1bde01d2ac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.219279 Aug 01 15:20:11.957966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 354/672] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:11 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:11.972652 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.980230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-67873c80-8660-4f4d-aced-313a1c85309a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.190727 Aug 01 15:20:11.980802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 319/673] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:11 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:12.786724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:12.787331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:12.793788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.794239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.795036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.795473 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.930303 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:12.939339 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e13c1f60-2c2f-49cd-804b-097d7c56ba33 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.156500 Aug 01 15:20:12.939911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 355/674] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:12 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:12.981047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:12.981642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:12.988392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.988828 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.989656 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.990084 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:13.007826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:13.008545 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:13.015218 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:13.015665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:13.016442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:13.016877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:13.202706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:13.211313 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:13.211928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:13.213576 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:13.214928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7a3c52d1-569b-41c6-81ad-73bcc07eaf9b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.237678 Aug 01 15:20:13.216366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 320/675] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:12 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:13.224372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b987dd11-c273-4838-8082-8b4bb2964eea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1363 microversion: 2.1 time: 0.219943 Aug 01 15:20:13.226206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 356/676] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:13 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:13.962621 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:13.963772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:13.970836 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:13.971289 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:13.972093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:13.972532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.110650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.118935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d102ce48-0c1f-4f32-820d-ecaf2e72972c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.161134 Aug 01 15:20:14.119510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 321/677] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:13 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:14.239556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:14.240159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:14.246771 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.247221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:14.247365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.247826 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:14.248014 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.248422 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.253921 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.254368 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.255291 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.255722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.443809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.446941 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.453213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.454902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.455574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d3a89270-179e-4034-b108-72438ffb9351 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1552 microversion: 2.1 time: 0.212106 Aug 01 15:20:14.456372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fb590248-7a2b-4bdd-ac28-9542db97570f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.220480 Aug 01 15:20:14.456497 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 322/678] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:14 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:14.456601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 357/679] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:14 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:14.475347 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:14.475946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:14.481923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.482369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.483160 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.483597 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.610620 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.618089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3d52f978-83d9-4f94-9ce0-7195f29278c7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1552 microversion: 2.1 time: 0.146447 Aug 01 15:20:14.618612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 323/680] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:14 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:14.638935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:14.643646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.644407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Searching by: {'deleted': False, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d'} {{(pid=117887) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 15:20:14.651752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.652198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.653006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.653486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.742169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.multi_cell_list [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 15:20:14.850487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-74c5f468-8bd1-46dc-acd5-eba2d030fbfb tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.215884 Aug 01 15:20:14.851108 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 358/681] 10.222.0.100 () {58 vars in 1130 bytes} [Mon Aug 1 15:20:14 2022] GET /compute/v2.1/servers => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:14.863494 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:14.864103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:14.870500 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.870945 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.872282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.872714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.006780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:15.016847 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a1aa4230-b9fc-4b79-b393-4add82b77853 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1552 microversion: 2.1 time: 0.157568 Aug 01 15:20:15.017424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 324/682] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:14 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:15.140079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:15.140601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:15.146590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.147069 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.147834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.148273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.302577 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:15.312030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-804ecfb5-e70e-46ce-a5d3-f8a9f709c338 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.175718 Aug 01 15:20:15.312679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 359/683] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:15 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:15.479091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:15.479648 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:15.485622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.486061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.486842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.487273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.619779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:15.628935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:15.630435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:15.631615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe87bcac-f0ed-44f9-8b88-31fc2bb504b9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.156516 Aug 01 15:20:15.632183 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 325/684] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:15 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:16.334153 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:16.334718 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:16.341774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:16.342221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:16.343016 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:16.343454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:16.589673 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99ea8f89-cebd-4b85-92d6-50825d034dd9"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:16.594020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:16.601544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:16.602130 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:16.603038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:16.603552 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:16.736399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:16.746250 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-409555cf-4e50-410c-b977-4d2408450efd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.416088 Aug 01 15:20:16.746953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 360/685] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:16 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:16.751482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:16.752859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:16.759597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:16.760181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:16.761139 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:16.761590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:16.879550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-edf9730c-f1d0-48b9-9181-1b56575ec913 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293926 Aug 01 15:20:16.880186 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 326/686] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:20:16 2022] POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:20:16.902068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:16.910850 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:16.912346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:16.913501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b5b198c8-66b0-4f07-b658-b6a216cae06e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.165632 Aug 01 15:20:16.914053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 361/687] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:16 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:16.922791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:20:16.922945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Mon Aug 1 15:20:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:20:17.768404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:17.769133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:17.775354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:17.775801 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:17.776563 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:17.776999 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:17.913807 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:17.921845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-25ffc0ef-4b9a-4828-90bb-73bd201e71c2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.158125 Aug 01 15:20:17.922411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 327/688] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:17 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:17.937050 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:17.937626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:17.944061 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:17.944503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:17.945249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:17.945674 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:18.086969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:18.095643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:18.097149 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:18.098304 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-769ad3f1-a280-46bb-b579-388be0f93b55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.165213 Aug 01 15:20:18.098913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 362/689] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:17 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:18.942748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:18.943344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:18.949909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:18.950220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:18.951014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:18.951447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:19.092004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:19.100168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-99d642fc-42ce-40a7-9aea-e025283b8342 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.161281 Aug 01 15:20:19.100742 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 328/690] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:18 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:19.124492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:19.125251 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:19.131783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:19.132228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:19.133020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:19.133453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:19.275246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:19.283947 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:19.285622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:19.286814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-62efffdc-294b-4929-8b77-7285d659bd53 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.166279 Aug 01 15:20:19.287368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 363/691] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:19 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:20.121306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:20.122893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:20.129747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:20.130189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:20.131009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:20.131442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:20.264570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:20.272524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-77ac0f21-6992-4faa-849c-eb7bdc85b62b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.155088 Aug 01 15:20:20.273082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 329/692] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:20 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:20.311590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:20.312249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:20.318864 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:20.319307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:20.320055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:20.320479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:20.454521 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:20.462606 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:20.464050 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:20.465736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1edd4c27-17a7-48dc-acee-da6faa8787a2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.158147 Aug 01 15:20:20.466274 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 364/693] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:20 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:21.294172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:21.294772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:21.301442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.301887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.302722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.303100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.436687 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:21.444896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7ad485cd-75ae-47e4-a1cd-a35d553d7d93 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.155350 Aug 01 15:20:21.445656 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 330/694] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:21 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:21.489065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:21.489735 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:21.496375 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.496824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.497591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.498026 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.632977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:21.641361 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:21.642876 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:21.644027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6f297645-ac3c-4f55-8989-b284089872b5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.158872 Aug 01 15:20:21.644582 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 365/695] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:21 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:22.467516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:22.468206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:22.474680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:22.475132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:22.475885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:22.476315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:22.490610 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:22.604737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:22.613258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3cd6763a-c502-4bbd-befb-e5683ad2bd49 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.150532 Aug 01 15:20:22.613821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 331/696] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:22 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:22.667221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:22.667827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:22.674385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:22.674880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:22.675640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:22.676074 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:22.694128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:22.805958 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:22.813986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:22.815531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:22.816690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-28c2542c-64ac-4e4b-b959-b2ed6bfd23f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.153278 Aug 01 15:20:22.817259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 366/697] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:22 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:23.095762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-68b40075-f0fc-4d9d-a77e-f0663ec8ce6a req-754dfaea-6b36-4fd2-b035-c9245f89ec5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50052019-4694-4875-8915-9392814a8aba", "name": "network-vif-plugged", "status": "completed", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:23.107304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-68b40075-f0fc-4d9d-a77e-f0663ec8ce6a req-754dfaea-6b36-4fd2-b035-c9245f89ec5b service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.107822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-68b40075-f0fc-4d9d-a77e-f0663ec8ce6a req-754dfaea-6b36-4fd2-b035-c9245f89ec5b service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.119375 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-68b40075-f0fc-4d9d-a77e-f0663ec8ce6a req-754dfaea-6b36-4fd2-b035-c9245f89ec5b service nova] Creating event network-vif-plugged:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:20:23.125045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-68b40075-f0fc-4d9d-a77e-f0663ec8ce6a req-754dfaea-6b36-4fd2-b035-c9245f89ec5b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 01 15:20:23.125642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 332/698] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:23.634847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:23.635476 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:23.642307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.642776 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.643539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.643966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.783352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:23.792943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-08359216-7244-4ad6-bd97-f7ad17f5751b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.162018 Aug 01 15:20:23.793543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 367/699] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:23 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:23.842795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:23.843496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:23.850906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.851354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.852126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.852559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.985148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:23.993367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:23.994932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:23.996113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cf6e97e2-b1b5-4465-85d0-f735836a8d9c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.158051 Aug 01 15:20:23.996672 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 333/700] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:23 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:24.814888 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:24.815491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:24.817838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:24.824982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:24.825452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:24.826225 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:24.826803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:24.962780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:24.970851 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dd5c40a5-4fcf-4ca8-ba8f-a02d2dcb94d5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.159799 Aug 01 15:20:24.971416 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 368/701] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:24 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:25.018923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:25.019507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:25.026211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.026646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.027932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.028364 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.158093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:25.166601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:25.168902 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:25.175009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81b2a42d-7c56-4b6e-8233-046c7e53758a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.155022 Aug 01 15:20:25.175009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 334/702] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:25 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:25.542544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:25.543307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:25.549533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.549987 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.550800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.551240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.681677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:25.690615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7e128f2c-eac8-4abe-9fcb-bc7ef3b01845 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1598 microversion: 2.1 time: 0.152231 Aug 01 15:20:25.691219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 369/703] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:25 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:25.991736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:25.992336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:25.999281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.999721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:26.000555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:26.000988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:26.149239 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:26.157360 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1b49b86-46ea-4a56-b849-a27bd2745781 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1725 microversion: 2.1 time: 0.169377 Aug 01 15:20:26.158023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 335/704] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:25 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:26.195993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:26.197422 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:26.203863 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=72 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:26.206496 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:26.207373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:26.208714 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:26.209405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:26.356345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:26.365355 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:26.366887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:26.368167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-99b8ad24-d668-4eb3-9a46-13ada3b59964 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.176183 Aug 01 15:20:26.368741 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 370/705] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:26 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:27.181005 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:27.181846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:27.190842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.191297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.192087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.192525 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.342721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:27.350782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9595c9d-9f3c-48fa-bda6-e20ff99462df tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1702 microversion: 2.1 time: 0.174810 Aug 01 15:20:27.351359 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 336/706] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:27 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1702 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:27.372455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-302992f8-c315-48e8-a6a3-5b569535c9bd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:27.379220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-302992f8-c315-48e8-a6a3-5b569535c9bd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.379673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-302992f8-c315-48e8-a6a3-5b569535c9bd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.391649 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:27.392285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:27.398480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.398940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.399930 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.400355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.402865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-302992f8-c315-48e8-a6a3-5b569535c9bd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Going to try to start instance {{(pid=117887) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:20:27.469844 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-302992f8-c315-48e8-a6a3-5b569535c9bd tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.101567 Aug 01 15:20:27.473824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 371/707] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:20:27 2022] POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:20:27.479454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:27.480143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:27.487685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.488423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.489484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.490083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.640881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:27.649235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:27.659309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:27.661086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eb2d26ce-eca4-4cc0-944f-f20df1054095 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1749 microversion: 2.20 time: 0.273499 Aug 01 15:20:27.661664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 337/708] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:27 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1749 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:27.775265 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:27.793553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-db98085f-6e83-4b62-84ac-cae3f51c9f0f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1711 microversion: 2.1 time: 0.318170 Aug 01 15:20:27.800993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 372/709] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:27 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1711 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:27.849771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-740a4728-7067-461f-b57a-ca94f25d590c req-26777370-92e8-4f22-88ca-a1bb8354bc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:27.871783 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-740a4728-7067-461f-b57a-ca94f25d590c req-26777370-92e8-4f22-88ca-a1bb8354bc67 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:27.872610 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-740a4728-7067-461f-b57a-ca94f25d590c req-26777370-92e8-4f22-88ca-a1bb8354bc67 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:27.885949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-740a4728-7067-461f-b57a-ca94f25d590c req-26777370-92e8-4f22-88ca-a1bb8354bc67 service nova] Creating event network-changed:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:20:27.904599 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-740a4728-7067-461f-b57a-ca94f25d590c req-26777370-92e8-4f22-88ca-a1bb8354bc67 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228597 Aug 01 15:20:27.906050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 338/710] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:28.689038 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:28.690344 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:28.703608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.704243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:28.705214 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.705851 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:28.821222 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:28.822133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:28.837060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.837517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:28.838296 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.838746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:29.205450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:29.217859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:29.221951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:29.223539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5a3a5300-9583-4cd3-9146-736faa80957c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.538901 Aug 01 15:20:29.226319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 373/711] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:28 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:29.257748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:29.280882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c8469513-684b-4266-8b2d-9a900ef675b7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1711 microversion: 2.1 time: 0.463655 Aug 01 15:20:29.282426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 339/712] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:28 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1711 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:29.310316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1684994932"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:29.311006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:29.317788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:29.318596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:29.319514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:29.320221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:29.566476 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.network.security_group_api [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Adding security group f9385c48-9d4a-4ff5-b79b-574d1c0025bf to port 47488f03-2d13-4e5e-a010-d1a9d89ebab6 Aug 01 15:20:29.940489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-52594147-975c-44af-9819-674dc17ebc01 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/action" status: 202 len: 0 microversion: 2.1 time: 0.634595 Aug 01 15:20:29.942907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 374/713] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:20:29 2022] POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:20:29.949945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:29.959900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:29.970067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:29.970621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:29.971534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:29.972102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.095796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-7d63b8e0-5a0b-47ac-a1e6-7e9fddd1d7e1 req-d7b750e5-6de2-4c0f-b6f5-1ddf9c564ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:30.107005 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7d63b8e0-5a0b-47ac-a1e6-7e9fddd1d7e1 req-d7b750e5-6de2-4c0f-b6f5-1ddf9c564ff4 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.107776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-7d63b8e0-5a0b-47ac-a1e6-7e9fddd1d7e1 req-d7b750e5-6de2-4c0f-b6f5-1ddf9c564ff4 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.129244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-7d63b8e0-5a0b-47ac-a1e6-7e9fddd1d7e1 req-d7b750e5-6de2-4c0f-b6f5-1ddf9c564ff4 service nova] Creating event network-changed:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:20:30.136317 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-7d63b8e0-5a0b-47ac-a1e6-7e9fddd1d7e1 req-d7b750e5-6de2-4c0f-b6f5-1ddf9c564ff4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190404 Aug 01 15:20:30.138472 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 340/714] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:30.189284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:30.202504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3833846c-3bc8-494e-a3f0-2e4565e6b126 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1763 microversion: 2.1 time: 0.256484 Aug 01 15:20:30.203747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 375/715] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:29 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1763 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:30.256816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:30.257525 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:30.278335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.278887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.279892 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.280378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.305966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:30.306636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:30.318299 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.318781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.322392 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.322934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.553685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:30.568966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:30.570763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:30.572056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0ea87b52-f3bc-4747-8806-cd95acb484fc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.320433 Aug 01 15:20:30.577004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 341/716] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:30 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:30.649515 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:30.660480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4b1afa09-93ac-4b8c-8b69-28a8d4dc23ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1711 microversion: 2.1 time: 0.358012 Aug 01 15:20:30.662110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 376/717] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:30 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1711 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:31.598544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:31.599525 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:31.611053 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.611887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.612925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.613603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.687500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:31.688286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:31.703314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.703767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.704707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.705151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.954794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:31.970519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:31.972716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:31.974319 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f9542931-15b4-4a84-9249-027ef27d069d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.379401 Aug 01 15:20:31.975185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 342/718] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:31 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:32.030815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:32.058821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c6dd7da1-5411-4a03-846e-24fe513cf3ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1715 microversion: 2.1 time: 0.379466 Aug 01 15:20:32.062020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 377/719] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:20:31 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1715 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:33.004217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:33.006870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:33.018273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:33.019101 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:33.020326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:33.021017 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:33.196797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.207108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.208622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.210134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58ebcb56-fb6d-4553-ad2e-f5122d635031 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.213106 Aug 01 15:20:33.210965 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 343/720] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:32 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:34.237594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:34.239376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:34.249265 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.249817 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.261122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.261122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.399649 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.408460 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.410179 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.411496 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-409caf55-e616-4de1-913d-e66fcf9e1cd0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.177834 Aug 01 15:20:34.414534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 378/721] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:34 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:35.436134 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:35.437399 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:35.444193 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.444633 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.445452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.445881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.603020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:35.612927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:35.614434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:35.616701 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eb153c48-6f5f-4118-8239-fc36c123345c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.184477 Aug 01 15:20:35.617916 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 344/722] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:35 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:36.647219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:36.648742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:36.656781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:36.657641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:36.659133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:36.659813 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:36.825159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.834171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.835901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.837158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c912bfb7-3903-45a0-bbd4-ade5463e47c1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.196869 Aug 01 15:20:36.843217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 379/723] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:36 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:37.863391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:37.864845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:37.874116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.874869 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.875791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.876369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:38.033390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:38.041794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:38.043679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:38.044857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-56e79b76-ec95-4c99-ad54-478170354538 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.187591 Aug 01 15:20:38.045541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 345/724] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:37 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:39.069411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:39.070008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:39.077213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.077917 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.078780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.079148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.240172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:39.254529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:39.256160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:39.258379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0e2cae4c-7ac0-4ecb-a5a1-46c692cf0345 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.192819 Aug 01 15:20:39.259555 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 380/725] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:39 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:40.287811 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:40.288409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:40.295691 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.296140 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.296920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.297371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.445156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:40.453592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:40.455169 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:40.456369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c2b44e33-4b4b-47a7-903c-390af381dd1c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1744 microversion: 2.20 time: 0.172553 Aug 01 15:20:40.456924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 346/726] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:40 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:41.479271 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:41.480499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:41.487133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:41.487577 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:41.488353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:41.488789 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:41.625909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:41.638906 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:41.640414 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:41.641567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-be3abbd4-f02d-4ddb-9856-e1ef5d72c92e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1726 microversion: 2.20 time: 0.166309 Aug 01 15:20:41.642118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 381/727] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:41 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:42.665556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:42.666318 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:42.668696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=62 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:42.674308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:42.674786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:42.675592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:42.676022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:42.810087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:42.818022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:42.819562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:42.820713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0778e274-fe63-433c-9c95-b8fd2122e7d7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1726 microversion: 2.20 time: 0.159158 Aug 01 15:20:42.821271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 347/728] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:42 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:43.522485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-0deb2829-65dc-4663-9aef-bce5a70330c8 req-d0c7ce46-59ab-4c47-910a-af7b15ca5c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50052019-4694-4875-8915-9392814a8aba", "name": "network-vif-unplugged", "status": "completed", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:43.532322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0deb2829-65dc-4663-9aef-bce5a70330c8 req-d0c7ce46-59ab-4c47-910a-af7b15ca5c12 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:43.532688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0deb2829-65dc-4663-9aef-bce5a70330c8 req-d0c7ce46-59ab-4c47-910a-af7b15ca5c12 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:43.544641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-0deb2829-65dc-4663-9aef-bce5a70330c8 req-d0c7ce46-59ab-4c47-910a-af7b15ca5c12 service nova] Creating event network-vif-unplugged:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:20:43.550385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-0deb2829-65dc-4663-9aef-bce5a70330c8 req-d0c7ce46-59ab-4c47-910a-af7b15ca5c12 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152673 Aug 01 15:20:43.550385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 382/729] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:20:43.845090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:43.845931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:43.852311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:43.852760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:43.853537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:43.853973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:43.987054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:43.995657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:43.997518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:43.998934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f366ed76-588a-48e2-a256-7d2e8e241367 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1726 microversion: 2.20 time: 0.157824 Aug 01 15:20:43.999506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 348/730] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:43 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:45.023572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:45.024470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:45.031064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.031517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.032309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.032741 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.037287 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:45.168809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:45.176758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:45.178249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:45.179443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a8192c63-9c51-4ea4-b9ab-aa371e0c4c64 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1669 microversion: 2.20 time: 0.160831 Aug 01 15:20:45.179992 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 383/731] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:45 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:45.202846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d165f8b-2cab-42c4-8e3f-45db9eb7a57c"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:45.205592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:45.212474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.212916 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.213680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.214108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.296309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:45.505050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-525bdb97-a3eb-4515-a853-3f618d6a0ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306213 Aug 01 15:20:45.505665 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 349/732] 10.222.0.100 () {62 vars in 1369 bytes} [Mon Aug 1 15:20:45 2022] POST /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:20:45.629554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:45.630133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:45.636898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.637343 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.638110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.638547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.769535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117887) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:20:45.841455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3981f3be-adbc-4b80-9fc5-c6e08d6c12ff tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/action" status: 202 len: 0 microversion: 2.20 time: 0.215745 Aug 01 15:20:45.842160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 384/733] 10.222.0.100 () {62 vars in 1324 bytes} [Mon Aug 1 15:20:45 2022] POST /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:20:45.850346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:45.850985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:45.857205 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.857655 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:45.858431 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:45.858943 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:46.005381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:46.014372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:46.015904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:46.017086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c2497683-be8c-44df-99d2-c6899d02e941 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1755 microversion: 2.20 time: 0.170700 Aug 01 15:20:46.017638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 350/734] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:45 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:47.044161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:47.044901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:47.050951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:47.051435 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:47.052220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:47.052633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:47.187842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:47.196212 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:47.197711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:47.198892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c71a4e57-91b2-44d1-a3cf-0f1e9b731cb3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1757 microversion: 2.20 time: 0.161826 Aug 01 15:20:47.199442 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 385/735] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:47 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:48.223577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:48.224290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:48.230928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:48.231376 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:48.232151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:48.232591 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:48.372668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:48.381950 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:48.383799 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:48.385021 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8890d754-7a83-41db-9e68-ffc01fe62b8c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.165826 Aug 01 15:20:48.385591 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 351/736] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:48 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:49.415012 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:49.417555 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:49.429080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:49.430108 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:49.432768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:49.435342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:49.619046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:49.637458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:49.639192 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:49.640518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8e5d5c8b-9fe1-4b0c-b2e6-bc777a555e29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.234041 Aug 01 15:20:49.641527 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 386/737] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:49 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:50.665567 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:50.666946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:50.674098 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:50.674950 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:50.675992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:50.676631 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:50.829618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:50.840132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:50.841662 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:50.842887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ed2ffc1c-544e-44b9-b935-e7ca163bcd94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.181172 Aug 01 15:20:50.843457 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 352/738] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:50 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:51.865653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:51.866273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:51.873148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:51.873591 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:51.874362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:51.874838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:52.017586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:52.026337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:52.030098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:52.030098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7f5c480f-6741-43d9-8d72-fafd8bf850cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.167517 Aug 01 15:20:52.030098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 387/739] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:51 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:53.056086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:53.057148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:53.068790 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:53.069749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:53.071077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:53.071802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:53.211855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:53.220591 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:53.222117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:53.223305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c251c71-50a0-45be-8af1-03bee2ce4d6b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.174680 Aug 01 15:20:53.223872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 353/740] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:53 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:54.248659 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:54.250223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:54.256782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:54.257231 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:54.258033 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:54.258489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:54.413598 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:54.425188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:54.426711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:54.427941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5c12ed7f-67cf-4656-8ae6-a1d535e82ede tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.184678 Aug 01 15:20:54.428645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 388/741] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:54 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:55.455758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:55.456507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:55.463211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:55.463663 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:55.464441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:55.464874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:55.605700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:55.614594 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:55.616133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:55.617297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7bfa420-5688-497d-93fa-53b1c536af0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.165669 Aug 01 15:20:55.617857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 354/742] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:55 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:55.985051 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f92b9f43-6ad8-4615-aff1-4ee652babbb2"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:55.987846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:55.994199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:55.994753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:55.996158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:55.996652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:56.643247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:56.643854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:56.652510 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:56.652951 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:56.653823 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:56.654526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:56.807031 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:56.815784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:56.817272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:56.818488 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e080b11b-6cbf-4b18-aa46-46cd6ceadf20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.179136 Aug 01 15:20:56.819131 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 355/743] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:56 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:57.845591 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:57.846548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:57.857262 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:57.858027 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:57.859364 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:57.860121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:58.011158 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:58.020067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:58.021540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:58.022945 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-acc3d404-fb16-46b0-b4f0-1211cb533a56 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.182722 Aug 01 15:20:58.023479 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 356/744] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:57 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:59.049760 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:59.050521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:59.058195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:59.059070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:59.060001 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:59.060502 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:59.215108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:59.219346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:59.221668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:59.222990 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-328b7a47-4927-4dd1-8759-0504d502ffc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.177083 Aug 01 15:20:59.223580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 357/745] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:20:59 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:00.249268 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:00.249931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:00.257387 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:00.257835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:00.258640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:00.259105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:00.409378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:00.419291 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:00.421423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:00.423925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1a00446-6276-4c43-b753-17d456d79c19 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.178281 Aug 01 15:21:00.426678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 358/746] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:00 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:01.448928 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:01.449706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:01.457383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:01.457829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:01.458598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:01.459081 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:01.594414 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:01.603910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:01.605924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:01.607109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b05a9587-92f3-40de-a50e-f296bc53ef4a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.162222 Aug 01 15:21:01.607662 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 359/747] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:01 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:02.632549 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:02.633250 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:02.639846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:02.640280 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:02.641036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:02.641460 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:02.780424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:02.789121 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:02.790607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:02.792364 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b880df82-10a2-40c6-bcca-2703d20dabe2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.163117 Aug 01 15:21:02.792931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 360/748] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:02 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:03.816530 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:03.817418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:03.826552 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:03.827040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:03.828070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:03.828505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:03.964007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:03.972887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:03.974430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:03.975777 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd17eca8-8da1-4839-ac3e-79a5cd1ed549 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.163288 Aug 01 15:21:03.976175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 361/749] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:03 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:04.998641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:04.999375 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:05.005753 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:05.006199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:05.006996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:05.007431 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:05.141716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:05.150367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:05.151913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:05.153077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3dfb734b-c6a4-42e8-872d-2e8fab3b8ed9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.158362 Aug 01 15:21:05.153699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 362/750] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:04 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:05.991484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:06.076091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:06.176126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:06.176713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:06.182956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:06.183404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:06.184177 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:06.184623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:06.320518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:06.330586 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:06.332100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:06.333260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bdb649e8-750d-458d-b763-e9e14ac662ec tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.161273 Aug 01 15:21:06.333816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 363/751] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:06 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:06.977723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9ff84804-d61f-4f10-94b2-8e304e2bac2d tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.113121 Aug 01 15:21:06.978347 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 389/752] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:20:55 2022] POST /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments => generated 194 bytes in 11115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:07.356300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:07.356947 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:07.363736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:07.364189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:07.364964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:07.365400 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:07.368255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:07.508249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:07.517570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:07.519126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:07.520297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-179eeef5-1ec8-4da0-9946-a0ef9ff04c7a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.167973 Aug 01 15:21:07.520860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 364/753] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:07 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:08.545925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:08.546625 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:08.554428 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:08.554904 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:08.555671 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:08.556120 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:08.699769 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:08.708858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:08.710354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:08.711571 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9a8319d0-7cb9-4c68-a5de-eca81c3f7845 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.171068 Aug 01 15:21:08.712129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 390/754] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:08 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:09.735393 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:09.735996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:09.742878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:09.743316 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:09.744073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:09.745097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:09.884701 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:09.894061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:09.895587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:09.896747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a7472d4-2377-47a8-911d-82c240980ed0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.165278 Aug 01 15:21:09.897306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 365/755] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:09 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:10.919658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:10.920512 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:10.927628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:10.928077 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:10.928884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:10.929318 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:11.063246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:11.071971 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:11.073468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:11.074632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5fcd6fa2-5e7c-44d6-ad30-962159ab536e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.159459 Aug 01 15:21:11.075215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 391/756] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:10 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:12.098310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:12.099005 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:12.105726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:12.106167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:12.106970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:12.107409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:12.245155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:12.257028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:12.258515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:12.259706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-215ad666-e365-4521-b58e-131b6545c116 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.165365 Aug 01 15:21:12.260261 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 366/757] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:12 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:13.283033 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:13.283666 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:13.290200 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:13.290644 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:13.291475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:13.291904 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:13.430378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:13.439461 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:13.440946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:13.442099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-53daddb9-06f1-45ee-90f3-8e6698681ada tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.163077 Aug 01 15:21:13.442651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 392/758] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:13 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:14.465788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:14.466425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:14.468880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=40 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:14.474604 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:14.475075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:14.475842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:14.476272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:14.619731 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:14.628150 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:14.629650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:14.630834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eb0cd4bc-61da-4052-be93-6ce6fe487e3c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.168966 Aug 01 15:21:14.631397 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 367/759] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:14 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:15.590343 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:15.592698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:15.599394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:15.599841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:15.600609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:15.601039 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:15.627095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lazy-loading 'flavor' on Instance uuid c7e33525-a6db-4813-8a29-1c5a1c5b33eb {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:21:15.656344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:15.657026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:15.663428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:15.663875 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:15.664648 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:15.665084 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:15.778314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fce77e47-cabd-4713-9ec0-34424afa5ead tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/action" status: 200 len: 32 microversion: 2.1 time: 0.192588 Aug 01 15:21:15.782809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 393/760] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:21:15 2022] POST /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:21:15.791368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:15.792360 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:15.799557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:15.799995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:15.800903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:15.801279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:15.818287 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:15.830022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:15.831551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:15.832774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e19887db-ef19-4a68-b4e2-66cd09b8060b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.180332 Aug 01 15:21:15.833653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 368/761] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:15 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:21:15.943258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:15.952703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7b38209c-d26a-479b-8ca5-d1035a62328c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.167249 Aug 01 15:21:15.953286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 394/762] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:15 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:16.856679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:16.857282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:16.864476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:16.864921 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:16.865695 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:16.866132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:16.973317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:16.973949 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:16.980690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:16.981111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:16.981884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:16.982319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:17.005689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:17.015420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:17.016929 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:17.018106 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5de34628-a971-44f0-8c13-cbe09964a9a0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.166113 Aug 01 15:21:17.018689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 369/763] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:16 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:17.115259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:17.123884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-339710d5-2e35-4ab2-b7eb-f47a1a6cf858 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.154389 Aug 01 15:21:17.124459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 395/764] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:16 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:17.858152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-20277a5a-f4b1-460c-8b95-063cc77d54be req-da25c88d-602e-4ae7-8085-20dd29213be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50052019-4694-4875-8915-9392814a8aba", "name": "network-vif-plugged", "status": "completed", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:17.869214 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-20277a5a-f4b1-460c-8b95-063cc77d54be req-da25c88d-602e-4ae7-8085-20dd29213be3 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:17.869655 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-20277a5a-f4b1-460c-8b95-063cc77d54be req-da25c88d-602e-4ae7-8085-20dd29213be3 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:17.881526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-20277a5a-f4b1-460c-8b95-063cc77d54be req-da25c88d-602e-4ae7-8085-20dd29213be3 service nova] Creating event network-vif-plugged:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:21:17.886614 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-20277a5a-f4b1-460c-8b95-063cc77d54be req-da25c88d-602e-4ae7-8085-20dd29213be3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Aug 01 15:21:17.887300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 370/765] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:18.042342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:18.042984 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:18.049543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:18.050000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:18.050803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:18.051243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:18.146159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:18.147551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:18.155011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:18.155560 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:18.156441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:18.156879 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:18.188326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:18.197794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:18.199447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:18.200711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e2523d4f-d3d1-45eb-b382-a8ee826ab678 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.162921 Aug 01 15:21:18.201357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 396/766] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:18 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:18.290215 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:18.298428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-32e54988-52a9-4450-bd1c-956cb6ee6f77 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.156648 Aug 01 15:21:18.299039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 371/767] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:18 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:19.227845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:19.228557 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:19.235907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:19.236352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:19.237593 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:19.238376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:19.320405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:19.321013 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:19.328421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:19.328867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:19.329647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:19.330078 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:19.416783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:19.425637 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:19.427191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:19.428359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7b847164-3bf2-4a96-8dd0-701ca6a50fac tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.204618 Aug 01 15:21:19.428919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 397/768] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:19 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:19.481646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:19.489853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3b99ae12-4076-4ca7-b6b3-e9e1f69055f8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.173697 Aug 01 15:21:19.490432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 372/769] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:19 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:20.452852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:20.453478 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:20.460078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:20.460517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:20.461280 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:20.461708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:20.511616 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:20.512269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:20.518927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:20.519463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:20.520143 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:20.520580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:20.910105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:20.919675 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:20.921169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:20.922342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-eb5f2fa4-8e6d-4a6d-970e-3708839a2f97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1813 microversion: 2.20 time: 0.473655 Aug 01 15:21:20.922932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 398/770] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:20 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1813 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:20.938024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:20.946472 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d7f60aba-64bb-4585-ad51-cee5a4f94a37 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.438784 Aug 01 15:21:20.947135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 373/771] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:20 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:21.945488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:21.946070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:21.953637 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:21.954078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:21.954896 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:21.955330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:21.968054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:21.968658 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:21.975413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:21.975863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:21.976638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:21.977073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:22.159328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:22.167082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:22.168648 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:22.170155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:22.171363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6d0b2657-f1ad-4077-aab4-d1408a49c45c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1800 microversion: 2.20 time: 0.229863 Aug 01 15:21:22.171916 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 399/772] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:21:21 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:22.176353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-93f21d15-36be-4662-a90c-c63bbbb67cc9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.212023 Aug 01 15:21:22.176931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 374/773] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:21 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:23.199488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:23.200168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:23.206898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:23.207346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:23.208115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:23.208545 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:23.344870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:23.353000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d2999ad8-227b-43fb-a730-f34d374174c2 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.158162 Aug 01 15:21:23.353634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 400/774] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:23 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:24.376422 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:24.377016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:24.383574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:24.384018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:24.384795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:24.385226 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:24.518808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:24.527268 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0263e51e-cc66-4b4c-bf8f-428cb8b025c6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.154725 Aug 01 15:21:24.527854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 375/775] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:24 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:25.548993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:25.549626 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:25.556836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.557257 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.558023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.558458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.642445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:21:25.643127 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:21:25.705020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:25.713081 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a64d673d-7a85-40ea-a0e8-930f11dd5262 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.167958 Aug 01 15:21:25.713665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 401/776] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:25 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:26.734900 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:26.735508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:26.742330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:26.742819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:26.743601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:26.744038 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:26.890000 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:26.898407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3be3c287-6fb8-4822-a070-38faf1d660da tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.167483 Aug 01 15:21:26.898931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 376/777] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:26 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:27.920975 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:27.921599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:27.928225 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:27.928674 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:27.929450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:27.929888 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:28.064366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:28.073163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-079459a8-17fd-45b2-862a-deb84a823c5f tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.156122 Aug 01 15:21:28.073728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 402/778] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:27 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:29.094822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:29.095419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:29.102359 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:29.102916 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:29.104271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:29.104705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:29.236664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:29.245220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-73949c64-3d9f-477a-af02-3a6b59330242 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.154263 Aug 01 15:21:29.245797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 377/779] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:29 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:30.266711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:30.267290 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:30.273968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:30.274415 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:30.275296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:30.275730 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:30.280050 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:30.414995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:30.424084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8078289a-2d1d-41c4-8d39-19975abaf3b8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.161327 Aug 01 15:21:30.424660 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 403/780] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:30 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:31.445423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:31.446048 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:31.453982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:31.454428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:31.455249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:31.455694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:31.593666 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:31.601878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e58c258a-0d11-4bbc-910b-d7c385977419 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.160258 Aug 01 15:21:31.602650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 378/781] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:31 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:32.623658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:32.624276 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:32.631267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.631716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.632494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.632928 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.772834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:32.781761 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a481aa63-ae75-46dd-b159-f0cde114ba8c tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.161992 Aug 01 15:21:32.782320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 404/782] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:32 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:33.803419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:33.803975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:33.810446 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:33.810948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:33.811708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:33.812148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:33.942470 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:33.951919 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0eaca3e8-bc97-4f22-9dab-b6463f351d9b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.152087 Aug 01 15:21:33.952491 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 379/783] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:33 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:34.973856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:34.974456 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:34.981265 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:34.981712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:34.982479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:34.982946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:35.115275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:35.123869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-31c3f87e-a047-4725-a02c-fe473ebfb8e0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1740 microversion: 2.1 time: 0.153908 Aug 01 15:21:35.124436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 405/784] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:34 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:36.145516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:36.146118 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:36.152437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.152885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.153657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.154094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.290885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:36.298994 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd35b9ad-0aac-4f95-b06d-926b03d12003 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1720 microversion: 2.1 time: 0.157367 Aug 01 15:21:36.299560 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 380/785] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:36 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:36.362394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:36.363052 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:36.365207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=33 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:36.371193 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.371665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.373045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.373473 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.466231 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] HTTP exception thrown: Cannot 'detach_volume' instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb while it is in vm_state rescued Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Request method failure captured: Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments/f92b9f43-6ad8-4615-aff1-4ee652babbb2 HTTP/1.1 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3iRa8nQuz8zJJ7zw4P6ORCW9wvF07J4tE_ci1BHwJVgFzKip30UyoE2M1ulTMJfh56fxizdNXnDDlcVxQtCyN9QzatO7rFkjIaEWa9yLtQ3G8GgCI796IsVloBdCYJ05MJ7CNX_dhWIhLF5oyNi3Rhk3mm7Vlv7JvTMnrC067Yxx4 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:21:36.467860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e5e42e0f0ef74615ac27486ada272fd8", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: ca1d32ee23bc42b38ea9a043f7a850f5 Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:21:36.469411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Cannot 'detach_volume' instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb while it is in vm_state rescued Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'server_id': 'c7e33525-a6db-4813-8a29-1c5a1c5b33eb', 'id': 'f92b9f43-6ad8-4615-aff1-4ee652babbb2'} Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:21:36.470268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb while it is in vm_state rescued Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb while it is in vm_state rescued Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:36.471972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Returning 409 to user: Cannot 'detach_volume' instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb while it is in vm_state rescued {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:21:36.473071 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8f668128-daa1-4fa4-ab69-f8a3ba8ae0ee tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments/f92b9f43-6ad8-4615-aff1-4ee652babbb2" status: 409 len: 152 microversion: 2.1 time: 0.111130 Aug 01 15:21:36.473071 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 406/786] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:21:36 2022] DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments/f92b9f43-6ad8-4615-aff1-4ee652babbb2 => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:21:36.478279 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:36.478837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:36.484801 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.485246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.486018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.486456 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.502033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:36.564920 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0e49849f-6f5b-49f8-a215-a076e6b3b2b0 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "POST /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/action" status: 202 len: 0 microversion: 2.1 time: 0.090180 Aug 01 15:21:36.565704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 381/787] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:21:36 2022] POST /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:21:36.574929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:36.575541 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:36.582529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.583153 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.583950 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.584470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.723559 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:36.732576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7afcde6b-ec47-42fa-9d33-2e185893cfdb tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1728 microversion: 2.1 time: 0.162038 Aug 01 15:21:36.733246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 407/788] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:36 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:37.756628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:37.757361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:37.764375 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:37.764829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:37.765603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:37.766039 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:37.903878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:37.912206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1f3d318e-7c38-493f-8b91-723edc0c8868 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1728 microversion: 2.1 time: 0.160286 Aug 01 15:21:37.912787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 382/789] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:37 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:38.938021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:38.939166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:38.952154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:38.952905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:38.954260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:38.955038 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:39.095537 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:39.103731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f7234f06-83a9-4c4f-8046-b86f495ff36b tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1728 microversion: 2.1 time: 0.173233 Aug 01 15:21:39.104305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 408/790] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:38 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:40.125407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:40.125998 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:40.132673 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:40.133113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:40.133992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:40.134420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:40.273495 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:40.282985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-29b53b59-8191-45d8-ae75-cdc37dbab7ce tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1728 microversion: 2.1 time: 0.161319 Aug 01 15:21:40.283571 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 383/791] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:40 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:41.304935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:41.305572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:41.312431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.312880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.313658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.314102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.444991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:41.455110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5cc1e69d-87be-44c0-8c29-8ac4dbccfb53 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1734 microversion: 2.1 time: 0.153968 Aug 01 15:21:41.455681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 409/792] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:41 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:41.476156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:41.476721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:41.483435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.483889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.484664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.485104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.563935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2708ec31-5568-4667-b798-72fd086cb6fe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091739 Aug 01 15:21:41.564532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 384/793] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:21:41 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:42.485552 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-b604063b-7927-4b18-9801-871d9f40bb08 req-eb80be1a-3f2f-4eec-b285-5db2dd1d0e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e33525-a6db-4813-8a29-1c5a1c5b33eb", "tag": "f47c057c-d9e2-4139-887f-aa554c5d32e5"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:42.500014 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-b604063b-7927-4b18-9801-871d9f40bb08 req-eb80be1a-3f2f-4eec-b285-5db2dd1d0e09 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:42.500444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-b604063b-7927-4b18-9801-871d9f40bb08 req-eb80be1a-3f2f-4eec-b285-5db2dd1d0e09 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:42.512364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-b604063b-7927-4b18-9801-871d9f40bb08 req-eb80be1a-3f2f-4eec-b285-5db2dd1d0e09 service nova] Creating event network-changed:f47c057c-d9e2-4139-887f-aa554c5d32e5 for instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb on hv-cinder-84327 Aug 01 15:21:42.517463 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-b604063b-7927-4b18-9801-871d9f40bb08 req-eb80be1a-3f2f-4eec-b285-5db2dd1d0e09 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035588 Aug 01 15:21:42.518063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 410/794] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:44.534689 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-5b1aade0-0924-49cc-bd5c-e87145c7907c req-f641bc70-cc43-42e8-8dc1-bc1c6a064e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e33525-a6db-4813-8a29-1c5a1c5b33eb", "tag": "f47c057c-d9e2-4139-887f-aa554c5d32e5"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:44.540235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=36 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:44.546467 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-5b1aade0-0924-49cc-bd5c-e87145c7907c req-f641bc70-cc43-42e8-8dc1-bc1c6a064e74 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:44.546858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-5b1aade0-0924-49cc-bd5c-e87145c7907c req-f641bc70-cc43-42e8-8dc1-bc1c6a064e74 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:44.563119 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-5b1aade0-0924-49cc-bd5c-e87145c7907c req-f641bc70-cc43-42e8-8dc1-bc1c6a064e74 service nova] Creating event network-changed:f47c057c-d9e2-4139-887f-aa554c5d32e5 for instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb on hv-cinder-84327 Aug 01 15:21:44.568255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-5b1aade0-0924-49cc-bd5c-e87145c7907c req-f641bc70-cc43-42e8-8dc1-bc1c6a064e74 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037788 Aug 01 15:21:44.568824 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 385/795] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:51.668862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:51.669564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:51.675899 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:51.676351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:51.677128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:51.677566 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:51.760925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lazy-loading 'services' on Instance uuid e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:21:51.840822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4015e136-fac9-43ea-91dd-edae8a5152db tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-volume_attachments/78c40bf4-2d99-4815-9dab-2122bb4495aa" status: 202 len: 0 microversion: 2.1 time: 0.178251 Aug 01 15:21:51.841418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 411/796] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:21:51 2022] DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-volume_attachments/78c40bf4-2d99-4815-9dab-2122bb4495aa => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:21:52.780068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:52.780621 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:52.786918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:52.787358 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:52.788129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:52.788596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:52.815602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:21:52.896914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3aabc2ab-841c-4b24-b4e0-c5bb48db5226 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "DELETE /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 204 len: 0 microversion: 2.1 time: 0.121510 Aug 01 15:21:52.897514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 386/797] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:21:52 2022] DELETE /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:21:52.907837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:52.908529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:52.915633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:52.916127 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:52.917026 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:52.917470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:53.085103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:53.094159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-78fb5469-326c-4427-a7b4-8ab66369a36f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1582 microversion: 2.1 time: 0.190993 Aug 01 15:21:53.094860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 412/798] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:52 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1582 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:54.035722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e47f612e-ce96-4d51-bfd8-ab78b1a976ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:54.042274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e47f612e-ce96-4d51-bfd8-ab78b1a976ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.042793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e47f612e-ce96-4d51-bfd8-ab78b1a976ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.106309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e47f612e-ce96-4d51-bfd8-ab78b1a976ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Going to try to stop instance {{(pid=117886) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:21:54.116253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:54.116869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:54.123728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.124177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.125026 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.125454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.156741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e47f612e-ce96-4d51-bfd8-ab78b1a976ea tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.125008 Aug 01 15:21:54.157628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 387/799] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:21:54 2022] POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:21:54.169517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:54.170768 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:54.178853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.179294 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.182411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.182875 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.316668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:54.324909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-11be7c44-5480-4411-a3a1-9f6d87bb0434 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1582 microversion: 2.1 time: 0.212607 Aug 01 15:21:54.325508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 413/800] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:54 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1582 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:54.367292 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:54.376910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e678f152-42d8-40ea-91a3-b7dcdb285ba5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.214364 Aug 01 15:21:54.377498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 388/801] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:54 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:55.347740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:55.348475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:55.356260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.356598 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.357396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.357834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.398250 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:55.399439 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:55.406046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.406812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.407605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.408046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.558954 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:55.569021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-726adf08-5c42-4ee6-8b64-937d4ac6618a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1582 microversion: 2.1 time: 0.225250 Aug 01 15:21:55.570377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 414/802] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:55 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1582 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:55.588175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:55.595877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5c5df8fd-ed6f-4fb4-afc6-845b0808b0c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.201419 Aug 01 15:21:55.596459 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 389/803] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:55 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:56.191514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:56.193813 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:56.210121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.210121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.210121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.210121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.292277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4b64ee69-d7e8-4f4e-bfeb-256a2c2bc1c9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/action" status: 202 len: 0 microversion: 2.1 time: 0.104579 Aug 01 15:21:56.293965 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 415/804] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:21:56 2022] POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:21:56.301792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:56.302564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:56.309796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.310780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.312211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.313025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.404018 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-0acc1626-65e7-45d7-a5c8-810191dd2f5d req-76efc549-2aca-43df-aac9-dc3bf98b9719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "853a94ee-fe3a-4c55-bbd8-1b3fd6045150", "name": "network-vif-deleted", "tag": "b050c354-7877-438f-8e45-4fd7ef23bdde"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:56.416922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0acc1626-65e7-45d7-a5c8-810191dd2f5d req-76efc549-2aca-43df-aac9-dc3bf98b9719 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.417495 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0acc1626-65e7-45d7-a5c8-810191dd2f5d req-76efc549-2aca-43df-aac9-dc3bf98b9719 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.431617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-0acc1626-65e7-45d7-a5c8-810191dd2f5d req-76efc549-2aca-43df-aac9-dc3bf98b9719 service nova] Creating event network-vif-deleted:b050c354-7877-438f-8e45-4fd7ef23bdde for instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 on hv-cinder-84327 Aug 01 15:21:56.452484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-0acc1626-65e7-45d7-a5c8-810191dd2f5d req-76efc549-2aca-43df-aac9-dc3bf98b9719 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052282 Aug 01 15:21:56.453480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 416/805] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:56.548573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:56.568478 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6992f757-b2b4-4eca-950c-a9cd44481f7b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1755 microversion: 2.1 time: 0.265200 Aug 01 15:21:56.569796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 390/806] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:56 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1755 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:56.617881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:56.619012 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:56.634099 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.634996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.637106 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.638685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.806248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:56.807012 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:56.822760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.823223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.824017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.824456 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.851250 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:56.862503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3eedc132-c3a3-49ae-815e-183f3d329968 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.248886 Aug 01 15:21:56.874696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 391/807] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:56 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:56.936013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:56.944377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a6ecbd75-9775-4f14-b92e-766c2ddca26b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1228 microversion: 2.1 time: 0.356670 Aug 01 15:21:56.946140 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 417/808] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:56 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1228 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:57.593444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:57.594059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:57.601199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.603361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:57.604231 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.604669 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:57.764924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:57.777322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0434308e-beb8-4be5-b9cd-d533f96ad292 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.187795 Aug 01 15:21:57.777912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 392/809] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:57 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:57.890538 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:57.891556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:57.903047 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.903494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:57.904269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.904704 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:57.968586 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:57.969247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:57.976593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.977334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:57.978304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.979009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:58.021685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:58.022223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:58.022859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lazy-loading 'fault' on Instance uuid 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:21:58.087450 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:58.096661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1e2d0bb4-a6a2-407b-b32e-250e00f44d8a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 200 len: 1187 microversion: 2.1 time: 0.132254 Aug 01 15:21:58.097506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 393/810] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:57 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 1187 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:58.098269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:58.109447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b0bbdbb1-6e1c-453c-91c6-7749b6715a2e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.224480 Aug 01 15:21:58.110129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 418/811] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:57 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:58.799932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:58.800540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:58.807902 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:58.808341 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:58.809099 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:58.809536 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:58.957267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:58.968411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-138ab346-585f-4372-978f-d3eb31693e55 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.172274 Aug 01 15:21:58.968998 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 394/812] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:58 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:59.117405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:59.118019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:59.124812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.125316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.126041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.126472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.130704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:59.131457 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:59.137976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.138425 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.139237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.139675 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.143045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] HTTP exception thrown: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:21:59.143230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Request method failure captured: Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 HTTP/1.1 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-5hErb8ovY5_w_WiBfbIfb8R2oHzuyr59JKxz7dp9wqQT-_OSzGnXaiMHP5egjWf-NsG0jy1n21zgTSTueqNZEtj-1x_YDqPiaRGEsHvRZECXVTwxJsFoXrUDBjzdyg472XrIcek2nS_afgs42a-0UG0-hXmLUim3-oDptHzPxROK0 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:21:59.143921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f44ad042ba9b4bdc91783fce54774c29", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: c6795a827b8d411aaa165db7b38435ce Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:21:59.147907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '853a94ee-fe3a-4c55-bbd8-1b3fd6045150'} Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:21:59.149596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:21:59.151056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:21:59.152387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Returning 404 to user: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:21:59.152387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-09498d3d-b947-4d84-86c8-98672e4cc38b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 404 len: 111 microversion: 2.1 time: 0.031778 Aug 01 15:21:59.152387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 419/813] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:59 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:21:59.200201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-85158510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-505595786", "security_groups": [{"name": "tempest-secgroup-smoke-1511582412"}], "block_device_mapping_v2": [{"uuid": "e4b16eb1-4631-4f52-b24d-94a48929a8c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b745091-6599-407e-ab8f-a04aefc65659"}]}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:59.342349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:59.350076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7c57f0ae-27ba-4343-9fa3-c2be31664613 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.223197 Aug 01 15:21:59.350927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 395/814] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:59 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:59.355248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] validate_networks() for [('7b745091-6599-407e-ab8f-a04aefc65659', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:21:59.739574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:21:59.739993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:21:59.740465 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:21:59.740870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:21:59.741277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:21:59.750573 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.751081 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.751901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.752335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.759773 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:59.775583 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for project f44ad042ba9b4bdc91783fce54774c29. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:21:59.780009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for user c6795a827b8d411aaa165db7b38435ce and project f44ad042ba9b4bdc91783fce54774c29. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:21:59.837873 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:21:59.840103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4b16eb1-4631-4f52-b24d-94a48929a8c8',volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:21:59.979459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-98754fb4-c0a7-4923-9319-910c312415f5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.783336 Aug 01 15:21:59.980108 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 420/815] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:21:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 01 15:21:59.989618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:59.990891 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:59.991152 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e87cd613-1783-4af1-9507-5177e3a36239 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:59.991770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e87cd613-1783-4af1-9507-5177e3a36239 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:00.000307 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.000562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.001584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.001806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.057960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e87cd613-1783-4af1-9507-5177e3a36239 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:00.065876 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e87cd613-1783-4af1-9507-5177e3a36239 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1095 microversion: 2.1 time: 0.078421 Aug 01 15:22:00.066556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 421/816] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:59 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:00.172293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:00.181507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e25caf60-141f-4c7b-a318-d1b61defdd06 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.196005 Aug 01 15:22:00.192011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 396/817] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:21:59 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:00.372504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:00.373361 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:00.381364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.382124 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.383243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.383834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.527273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:00.535452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6df3ac1c-6dae-4518-b059-75bb13dca749 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.168051 Aug 01 15:22:00.536025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 422/818] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:00 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:01.091008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:01.091637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:01.098278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.098754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.099517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.099943 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.169926 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:01.178580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1a890bd-b1f2-4f5b-9e6a-2460ed04cc1f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1201 microversion: 2.1 time: 0.091691 Aug 01 15:22:01.179305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 397/819] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:01 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:01.205904 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:01.206519 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:01.213942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.214402 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.215269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.215715 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.381853 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:01.392527 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-023d06dc-253d-4307-99e8-e4833b52b684 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.190453 Aug 01 15:22:01.393098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 423/820] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:01 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:01.557946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:01.558727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:01.564835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.565297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.566056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.566493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.705661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:01.713320 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4674c0c4-ebeb-4689-9698-b8749645b735 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.159822 Aug 01 15:22:01.713899 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 398/821] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:01 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:02.200845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:02.201725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:02.208423 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.209063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.209851 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.210292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.346969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:02.355400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8fce7883-370b-40f3-9b8e-536fbc0375a8 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.158446 Aug 01 15:22:02.355982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 424/822] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:02 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:02.415014 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:02.415555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:02.422921 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.423377 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.424157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.424605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.582506 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-fbbd8df9-6a3a-4d95-90e1-d711e250551d req-dc00bf2c-03d6-4d51-9d94-ae1e26020c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94042375-a5dd-4da8-9b2e-daba0cfbefb5", "tag": "47316b28-181a-4fa1-8973-c18fef74f52d"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:02.588819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:02.597601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-fbbd8df9-6a3a-4d95-90e1-d711e250551d req-dc00bf2c-03d6-4d51-9d94-ae1e26020c14 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.597970 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-fbbd8df9-6a3a-4d95-90e1-d711e250551d req-dc00bf2c-03d6-4d51-9d94-ae1e26020c14 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.598640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7c6b890b-de97-4b8d-a106-8bc264a038e9 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.187019 Aug 01 15:22:02.599913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 399/823] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:02 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:02.619532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-fbbd8df9-6a3a-4d95-90e1-d711e250551d req-dc00bf2c-03d6-4d51-9d94-ae1e26020c14 service nova] Creating event network-changed:47316b28-181a-4fa1-8973-c18fef74f52d for instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 on hv-cinder-84327 Aug 01 15:22:02.624861 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-fbbd8df9-6a3a-4d95-90e1-d711e250551d req-dc00bf2c-03d6-4d51-9d94-ae1e26020c14 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046747 Aug 01 15:22:02.625454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 425/824] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:22:02.735202 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:02.735810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:02.741946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.742394 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.743189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.743619 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.885244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:02.893028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f2d876ea-05a3-47ac-98ff-fe3bb179608a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.161625 Aug 01 15:22:02.893608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 400/825] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:02 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:03.377857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:03.378562 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:03.385312 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.385762 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.386540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.387005 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.528747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:03.536392 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9c2ab660-6582-41ee-803d-f9927bfad28f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.162771 Aug 01 15:22:03.536969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 426/826] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:03 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:03.620024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:03.620623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:03.627289 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.627741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.628516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.628959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.771947 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:03.780746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-983369d5-d17f-4fc4-89ac-bcffd2f0b818 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.164572 Aug 01 15:22:03.781322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 401/827] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:03 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:03.917519 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:03.918173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:03.924760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.925217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.925997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.926434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.059924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:04.067672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2d158501-381d-460c-a87d-61a0b1af6928 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.154718 Aug 01 15:22:04.068248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 427/828] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:03 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:04.561858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:04.562455 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:04.568664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:04.569104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.569880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:04.571010 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.707484 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:04.715324 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81877152-f392-4e68-b5d8-c78924eccace tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.157484 Aug 01 15:22:04.715895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 402/829] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:04 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:04.802395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:04.802926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:04.809702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:04.810145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.810930 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:04.811363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.954858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:04.962997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dd042e3b-9173-4619-8995-525dade2f192 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.164426 Aug 01 15:22:04.963570 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 428/830] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:04 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:05.090471 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:05.091018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:05.097267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.097722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.098507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.098985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.237353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:05.244974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4e09336-46e8-454a-83ff-fcc06e48af9b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.159017 Aug 01 15:22:05.245554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 403/831] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:05 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:05.736985 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:05.737596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:05.743778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.744230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.745004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.745441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.889096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:05.899388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f2ca2c9e-21f9-4a2a-9384-a95f96a7eb96 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.166169 Aug 01 15:22:05.900447 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 429/832] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:05 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:05.985729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:05.986341 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:05.993087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.993531 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.994293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.994739 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.146259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:06.154467 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ab34d57c-9286-45d4-ac25-0923c925c34f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.172663 Aug 01 15:22:06.155075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 404/833] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:05 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:06.266815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:06.267498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:06.274145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.274964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.276713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.277160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.412990 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:06.421322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d6f80b90-35cb-41bd-b00b-18d875144163 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.158544 Aug 01 15:22:06.421963 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 430/834] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:06 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:06.922770 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:06.923372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:06.929963 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.930403 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.931193 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.931709 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.067358 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:07.075524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b3bf5db6-a631-4d78-a74d-4d934c8b7bde tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.156579 Aug 01 15:22:07.076335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 405/835] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:06 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:07.176302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:07.176814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:07.178824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:07.184829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.185269 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.186036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.186463 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.339251 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:07.347296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-50331273-408c-45cf-b0bb-b2e09746b652 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.174926 Aug 01 15:22:07.347865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 431/836] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:07 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:07.442755 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:07.443274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:07.449389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.449823 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.450572 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.451413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.585360 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:07.594697 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8346ce5c-ed05-44a4-be26-de1add02806d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.155843 Aug 01 15:22:07.595277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 406/837] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:07 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:08.098139 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:08.098848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:08.105869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.106315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.107131 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.107561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.252898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:08.262298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-95177ec9-1c74-4574-b04e-7dc54d124003 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.167756 Aug 01 15:22:08.262298 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 432/838] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:08 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:08.369736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:08.370390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:08.377176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.377625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.378402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.378888 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.523954 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:08.532016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bc2c8fa6-0cff-4f1c-aeee-0b79b6f103b7 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1760 microversion: 2.1 time: 0.166351 Aug 01 15:22:08.532589 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 407/839] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:08 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:08.615709 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:08.616296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:08.625103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.625793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.627086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.627778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.767158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:08.777569 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ad2fc915-4673-420d-9d6c-ffdc27d9b4c5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.165272 Aug 01 15:22:08.778068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 433/840] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:08 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:09.282954 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:09.283563 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:09.293982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.294430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.295230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.295666 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.553376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:09.553982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:09.560995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.561435 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.562202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.562629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.733509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:09.741852 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d8d02e46-e3ba-4cd3-95b5-42fb298e315b tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.462757 Aug 01 15:22:09.749451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 408/841] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:09 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:09.760854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:09.775041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:09.783252 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-19b26201-2cc4-40ab-9db8-b6dfe2a735d6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1763 microversion: 2.1 time: 0.233636 Aug 01 15:22:09.783830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 434/842] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:09 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1763 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:09.798942 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:09.799692 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:09.806110 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.806457 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.807371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.807803 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.946555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:09.954686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5e7dae9c-c67e-4b1f-8126-841a4fef5508 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1679 microversion: 2.1 time: 0.159623 Aug 01 15:22:09.955257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 409/843] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:09 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:10.763666 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:10.764228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:10.766053 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=8 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:10.771776 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.772221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:10.773062 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.773503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:10.906536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:10.915444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e433a990-81ca-410e-a4cc-47e3334d84ff tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.154888 Aug 01 15:22:10.915444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 435/844] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:10 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:10.977108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:10.977959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:10.985254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.985698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:10.986462 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.986925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.126116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:11.133748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3d097822-4d6d-4972-a179-ecf745131f29 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1656 microversion: 2.1 time: 0.161216 Aug 01 15:22:11.134325 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 410/845] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:10 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:11.154467 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7b5a01c3-a4b6-4117-b96b-92c99fca7d6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:11.160567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b5a01c3-a4b6-4117-b96b-92c99fca7d6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.161007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7b5a01c3-a4b6-4117-b96b-92c99fca7d6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.184486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7b5a01c3-a4b6-4117-b96b-92c99fca7d6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Going to try to start instance {{(pid=117887) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:22:11.229615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7b5a01c3-a4b6-4117-b96b-92c99fca7d6a tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.078859 Aug 01 15:22:11.230248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 436/846] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:22:11 2022] POST /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:22:11.238441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:11.239072 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:11.244934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.245379 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.246142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.246564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.381554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:11.383853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:11.390651 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1621dce2-ea6e-4ff4-a2a1-293f66e746e1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1665 microversion: 2.1 time: 0.155874 Aug 01 15:22:11.391274 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 411/847] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:11 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:11.937248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:11.937964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:11.946385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.946877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.947667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.948107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.100485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:12.108872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-78c2a320-35f3-4cac-b9f8-7e5e0e8dddca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.176322 Aug 01 15:22:12.109675 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 437/848] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:11 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:12.412511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:12.413118 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:12.419936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.420382 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.421154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.421588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.560473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:12.569408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db354687-c801-4fbc-b261-509d3757215b tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1665 microversion: 2.1 time: 0.160865 Aug 01 15:22:12.570559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 412/849] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:12 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:13.130914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:13.131530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:13.138706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.139154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:13.139914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.140341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:13.144856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:13.274741 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:13.282710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-199b81da-7297-43e5-8c66-e2a5e8b75bc3 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.155826 Aug 01 15:22:13.283312 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 438/850] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:13 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:13.591643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:13.592292 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:13.599100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.599553 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:13.600354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.600795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:13.735938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:13.744236 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3a8c7da4-d86d-4205-af43-e137fdad3aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1669 microversion: 2.1 time: 0.156467 Aug 01 15:22:13.744808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 413/851] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:13 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:14.020076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-46d69e76-0052-473d-8ebe-e4fce47b7bd9 req-3863a930-3c25-4d56-a84a-4383ffacbf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94042375-a5dd-4da8-9b2e-daba0cfbefb5", "name": "network-vif-plugged", "status": "completed", "tag": "47316b28-181a-4fa1-8973-c18fef74f52d"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:14.030348 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-46d69e76-0052-473d-8ebe-e4fce47b7bd9 req-3863a930-3c25-4d56-a84a-4383ffacbf96 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:14.030822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-46d69e76-0052-473d-8ebe-e4fce47b7bd9 req-3863a930-3c25-4d56-a84a-4383ffacbf96 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:14.044838 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-46d69e76-0052-473d-8ebe-e4fce47b7bd9 req-3863a930-3c25-4d56-a84a-4383ffacbf96 service nova] Creating event network-vif-plugged:47316b28-181a-4fa1-8973-c18fef74f52d for instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 on hv-cinder-84327 Aug 01 15:22:14.049830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-46d69e76-0052-473d-8ebe-e4fce47b7bd9 req-3863a930-3c25-4d56-a84a-4383ffacbf96 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Aug 01 15:22:14.050632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 439/852] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:14.304645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:14.305148 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:14.311690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:14.312133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:14.312906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:14.313334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:14.452229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:14.463378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2bcecb87-bd84-439f-8404-8541202166fc tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.163201 Aug 01 15:22:14.463956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 414/853] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:14 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:15.485474 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:15.486205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:15.493230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:15.493674 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:15.494443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:15.494907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:15.634140 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:15.641858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-38c19d88-4692-4ca3-ba23-af52fb3efa6a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1267 microversion: 2.1 time: 0.160620 Aug 01 15:22:15.642433 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 440/854] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:15 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:16.662692 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:16.663311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:16.665680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:16.671859 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:16.672372 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:16.673150 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:16.673586 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:16.806878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:16.816235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7df8a3bb-ebf0-4e27-9683-b2dd7b4205e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1454 microversion: 2.1 time: 0.157254 Aug 01 15:22:16.816827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 415/855] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:16 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:16.837047 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:16.837756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:16.844470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:16.844913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:16.845678 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:16.846112 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:16.978045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:16.985609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-13ff7cc3-c053-4a67-a418-548beba6e409 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1454 microversion: 2.1 time: 0.152591 Aug 01 15:22:16.986166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 441/856] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:16 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:18.642821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a3f4c20e-341f-4cb0-9ce0-c7ef481b65d0 req-fbe50c0a-a50b-4b18-9d52-6a208a058565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94042375-a5dd-4da8-9b2e-daba0cfbefb5", "tag": "47316b28-181a-4fa1-8973-c18fef74f52d"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:18.653690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a3f4c20e-341f-4cb0-9ce0-c7ef481b65d0 req-fbe50c0a-a50b-4b18-9d52-6a208a058565 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:18.654129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a3f4c20e-341f-4cb0-9ce0-c7ef481b65d0 req-fbe50c0a-a50b-4b18-9d52-6a208a058565 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:18.666418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a3f4c20e-341f-4cb0-9ce0-c7ef481b65d0 req-fbe50c0a-a50b-4b18-9d52-6a208a058565 service nova] Creating event network-changed:47316b28-181a-4fa1-8973-c18fef74f52d for instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 on hv-cinder-84327 Aug 01 15:22:18.671679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a3f4c20e-341f-4cb0-9ce0-c7ef481b65d0 req-fbe50c0a-a50b-4b18-9d52-6a208a058565 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032500 Aug 01 15:22:18.672447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 416/857] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:39.033783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:39.034440 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:39.036549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=21 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:39.039981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=18 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:39.047582 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.048059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.048843 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.049279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.084125 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3ac058e5-8a74-4216-9080-f6eaa116709e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments/6d165f8b-2cab-42c4-8e3f-45db9eb7a57c" status: 200 len: 194 microversion: 2.20 time: 0.054457 Aug 01 15:22:39.084727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 442/858] 10.222.0.100 () {60 vars in 1459 bytes} [Mon Aug 1 15:22:39 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments/6d165f8b-2cab-42c4-8e3f-45db9eb7a57c => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:22:39.151992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:39.152735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=27 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:39.157302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:39.157881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:39.164906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.165330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.166093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.166528 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.247601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lazy-loading 'services' on Instance uuid 50052019-4694-4875-8915-9392814a8aba {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:22:39.324150 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0308657c-c0bb-4a7e-bfa2-1ef2f8c50d94 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments/6d165f8b-2cab-42c4-8e3f-45db9eb7a57c" status: 202 len: 0 microversion: 2.20 time: 0.173597 Aug 01 15:22:39.325365 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 417/859] 10.222.0.100 () {60 vars in 1462 bytes} [Mon Aug 1 15:22:39 2022] DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments/6d165f8b-2cab-42c4-8e3f-45db9eb7a57c => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:39.334030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:39.336193 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:39.342748 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.343201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.343982 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.344586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.376856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6a8e7884-2fb5-454c-87fc-fe530a87051c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046793 Aug 01 15:22:39.377431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 443/860] 10.222.0.100 () {60 vars in 1348 bytes} [Mon Aug 1 15:22:39 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:22:40.390507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:40.392737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:40.399802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:40.400240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:40.401004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:40.401428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:40.434759 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1f717eb-2854-42fe-b647-100926e6f739 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048952 Aug 01 15:22:40.435223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 418/861] 10.222.0.100 () {60 vars in 1348 bytes} [Mon Aug 1 15:22:40 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:22:41.448745 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:41.451181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:41.457730 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:41.458175 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.459065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:41.459502 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.489084 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-60e2f39c-abe8-43b0-9ba4-155df3d956f7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044299 Aug 01 15:22:41.489647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 444/862] 10.222.0.100 () {60 vars in 1348 bytes} [Mon Aug 1 15:22:41 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:41.553290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:41.553780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:41.560404 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:41.560854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.561631 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:41.562070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.587932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:22:41.673166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-61699797-093b-4ab8-8920-36b0141002b7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 204 len: 0 microversion: 2.20 time: 0.124105 Aug 01 15:22:41.674754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 419/863] 10.222.0.100 () {60 vars in 1285 bytes} [Mon Aug 1 15:22:41 2022] DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 15:22:41.683035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:41.683671 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:41.689753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:41.690206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.691004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:41.691440 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.825831 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:41.834433 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:41.836066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:41.837254 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-41c64f4f-71f6-4fa5-b920-586b753c9537 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.158190 Aug 01 15:22:41.837805 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 445/864] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:41 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:42.861542 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:42.862233 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:42.868815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:42.869254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:42.870013 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:42.870473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:43.026289 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:43.034842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:43.036356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:43.037521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af3e600a-cd26-45b6-836a-ff6d68bfe718 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.180292 Aug 01 15:22:43.038092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 420/865] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:42 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:44.063028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:44.064081 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:44.071575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:44.072216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:44.073186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:44.073815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:44.238234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:44.247276 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:44.248801 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:44.250021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d8a89a4f-6bca-41cb-bc32-17e82e3586d8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1728 microversion: 2.20 time: 0.193072 Aug 01 15:22:44.250585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 446/866] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:44 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:45.130568 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-00d32eae-71cd-49f3-9276-94bee6579f94 req-acd24cd3-5c57-4bf7-8535-4bf320e0c90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50052019-4694-4875-8915-9392814a8aba", "name": "network-vif-deleted", "tag": "2b91be83-abf2-4049-bb92-3eadd88372f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:45.141824 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-00d32eae-71cd-49f3-9276-94bee6579f94 req-acd24cd3-5c57-4bf7-8535-4bf320e0c90f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:45.142273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-00d32eae-71cd-49f3-9276-94bee6579f94 req-acd24cd3-5c57-4bf7-8535-4bf320e0c90f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:45.153943 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-00d32eae-71cd-49f3-9276-94bee6579f94 req-acd24cd3-5c57-4bf7-8535-4bf320e0c90f service nova] Creating event network-vif-deleted:2b91be83-abf2-4049-bb92-3eadd88372f3 for instance 50052019-4694-4875-8915-9392814a8aba on hv-cinder-84327 Aug 01 15:22:45.159237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-00d32eae-71cd-49f3-9276-94bee6579f94 req-acd24cd3-5c57-4bf7-8535-4bf320e0c90f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Aug 01 15:22:45.159914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 421/867] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:45.274339 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:45.275007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:45.284721 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:45.285179 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:45.286238 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:45.287405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:45.326159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:45.326912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:45.327534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lazy-loading 'fault' on Instance uuid 50052019-4694-4875-8915-9392814a8aba {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:22:45.377384 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:45.386865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:45.388651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:45.389836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-27c464a0-6426-4054-8e7f-e7838d2e5d37 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 200 len: 1375 microversion: 2.20 time: 0.120297 Aug 01 15:22:45.390397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 447/868] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:45 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 1375 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:46.414608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:46.415336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:46.421998 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:46.422451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:46.423282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:46.423722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:46.438719 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] HTTP exception thrown: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Request method failure captured: Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba HTTP/1.1 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3kD8Gug3x-fFzjoyeyKso5cLAJDwPhXLj_fachHJmOBm8JWYF9sLgPG3mH7IS-74rg4N_iaDq2INzA1gfoqRdRsfa23sMqHJHisYPV5_hC1mliUF7oP1pDjYZ_WpCJDM3NUvgjImO5lrhz0AyxD-p-qDWvz8TCSUPyhEhiA9rJva4 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:22:46.440402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2bb9ac7a058f47f39a01b9bd92c7f4a2", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 424ccf230e16423a8dd32097d90c4995 Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:22:46.443490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '50052019-4694-4875-8915-9392814a8aba'} Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:22:46.444405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:22:46.446970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:46.448657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Returning 404 to user: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:22:46.448657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-661e78be-7412-420a-ac1a-c6a60ea3c433 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 404 len: 111 microversion: 2.20 time: 0.032142 Aug 01 15:22:46.448657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 422/869] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:46 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:22:46.452093 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1a1812d4-80f3-4ae7-8adb-7eadfe9b978f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '.version_select at 0x7efd21821c10>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:46.476508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1a1812d4-80f3-4ae7-8adb-7eadfe9b978f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989922037" status: 204 len: 0 microversion: 2.20 time: 0.028492 Aug 01 15:22:46.477490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 448/870] 10.222.0.100 () {60 vars in 1264 bytes} [Mon Aug 1 15:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989922037 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:22:47.166284 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe6ecdd8-c147-4467-a290-921adebf94b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'create', calling method: .version_select at 0x7efd1d053670>, body: {"keypair": {"name": "tempest-keypair-497209756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEp60728Xc0ybLKYtLjnGQLxRNvprG1NsMg9aqnEseOkyUt1xW/rgERUiOWqf9kwfs4UplqVZElPZCTRi2PAyrLpVEwaNqlrsxeFQPABOhoCbzaCuq4p9Xpk0bqm59NpTg=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:47.182139 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-fe6ecdd8-c147-4467-a290-921adebf94b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:22:47.186200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-fe6ecdd8-c147-4467-a290-921adebf94b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for user 424ccf230e16423a8dd32097d90c4995 and project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:22:47.210163 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe6ecdd8-c147-4467-a290-921adebf94b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048455 Aug 01 15:22:47.210902 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 423/871] 10.222.0.100 () {62 vars in 1205 bytes} [Mon Aug 1 15:22:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:22:48.568340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-605542022", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5b35e26-bb0e-4039-aefb-c5e5ee561d48"}], "security_groups": [{"name": "tempest-securitygroup--712458355"}], "key_name": "tempest-keypair-497209756", "user_data": "}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:48.678808 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] validate_networks() for [('e5b35e26-bb0e-4039-aefb-c5e5ee561d48', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:22:49.068484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:22:49.068905 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:22:49.069376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:22:49.069783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:22:49.070188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:22:49.079595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:49.080044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:49.080842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:49.081277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:49.099938 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:22:49.104266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Getting quotas for user 424ccf230e16423a8dd32097d90c4995 and project 2bb9ac7a058f47f39a01b9bd92c7f4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:22:49.116364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:22:49.118610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:22:49.169034 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4fbfe0b3-a7c2-431c-aff0-5bfb74831eb1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.605506 Aug 01 15:22:49.169723 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 449/872] 10.222.0.100 () {62 vars in 1193 bytes} [Mon Aug 1 15:22:48 2022] POST /compute/v2.1/servers => generated 403 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 01 15:22:49.181142 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d4ba5704-b7b1-4b41-ba0a-d9fac20e1edd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:49.181789 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d4ba5704-b7b1-4b41-ba0a-d9fac20e1edd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:49.184377 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:49.185426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:49.193300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:49.193300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:49.193657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:49.194356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:49.236201 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d4ba5704-b7b1-4b41-ba0a-d9fac20e1edd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:49.244462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d4ba5704-b7b1-4b41-ba0a-d9fac20e1edd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:49.246202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d4ba5704-b7b1-4b41-ba0a-d9fac20e1edd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:49.247489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d4ba5704-b7b1-4b41-ba0a-d9fac20e1edd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1284 microversion: 2.20 time: 0.070965 Aug 01 15:22:49.248049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 450/873] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:49 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1284 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:22:49.282012 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lazy-loading 'services' on Instance uuid c7e33525-a6db-4813-8a29-1c5a1c5b33eb {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:22:49.356677 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f86c8b9-260a-4366-a986-d281482fdee5 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments/f92b9f43-6ad8-4615-aff1-4ee652babbb2" status: 202 len: 0 microversion: 2.1 time: 0.192567 Aug 01 15:22:49.357357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 424/874] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:22:49 2022] DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments/f92b9f43-6ad8-4615-aff1-4ee652babbb2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:22:49.365749 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:49.368191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:49.375430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:49.375884 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:49.376658 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:49.377147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:49.408851 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-81b81268-12bf-47ab-81e6-8b183ba7b6be tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Aug 01 15:22:49.409416 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 451/875] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:22:49 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:50.272357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0b3a299d-dd58-4c9e-81e7-74457eba77b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:50.273058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0b3a299d-dd58-4c9e-81e7-74457eba77b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:50.328578 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0b3a299d-dd58-4c9e-81e7-74457eba77b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:50.340303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0b3a299d-dd58-4c9e-81e7-74457eba77b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:50.340303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0b3a299d-dd58-4c9e-81e7-74457eba77b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:50.340303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0b3a299d-dd58-4c9e-81e7-74457eba77b2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1284 microversion: 2.20 time: 0.071567 Aug 01 15:22:50.340842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 425/876] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:50 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1284 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:50.423520 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:50.425763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:50.436101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:50.436621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:50.437758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:50.438196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:50.477366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ec510d1b-c53a-4493-9d70-01e1e8160ea6 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057978 Aug 01 15:22:50.478176 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 452/877] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:22:50 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:22:50.554693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:50.555208 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:50.562212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:50.562788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:50.563566 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:50.564033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:50.591235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:22:50.671180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1d5e8f13-6053-478e-a33b-94f9054359c8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 204 len: 0 microversion: 2.1 time: 0.120387 Aug 01 15:22:50.671786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 426/878] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:22:50 2022] DELETE /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:50.679595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:50.680191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:50.686234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:50.686717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:50.687501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:50.687942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:50.833408 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:50.839818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b11abccf-6f79-4f7f-8fff-3e81d950d372 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1694 microversion: 2.1 time: 0.164059 Aug 01 15:22:50.840387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 453/879] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:50 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:51.361547 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-470a6bf8-2384-44f1-931c-6782b966eebf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:51.362237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-470a6bf8-2384-44f1-931c-6782b966eebf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:51.421412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-470a6bf8-2384-44f1-931c-6782b966eebf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:51.432222 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-470a6bf8-2384-44f1-931c-6782b966eebf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:51.433895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-470a6bf8-2384-44f1-931c-6782b966eebf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:51.435093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-470a6bf8-2384-44f1-931c-6782b966eebf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1284 microversion: 2.20 time: 0.077649 Aug 01 15:22:51.435854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 427/880] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:51 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1284 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:51.860943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:51.861575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:51.868217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:51.868669 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:51.869449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:51.869887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:52.005925 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:52.014020 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-da2a8052-87ec-41e1-9474-49e01b811685 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1694 microversion: 2.1 time: 0.156927 Aug 01 15:22:52.014608 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 454/881] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:51 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:52.461881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-49151a97-d967-4394-b225-1eec4bd6459a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:52.463086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-49151a97-d967-4394-b225-1eec4bd6459a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:52.530118 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-49151a97-d967-4394-b225-1eec4bd6459a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:52.538715 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-49151a97-d967-4394-b225-1eec4bd6459a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:52.540214 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-49151a97-d967-4394-b225-1eec4bd6459a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:52.541335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-49151a97-d967-4394-b225-1eec4bd6459a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1284 microversion: 2.20 time: 0.084934 Aug 01 15:22:52.542194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 428/882] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:52 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:53.035908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:53.036597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:53.043345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:53.043796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:53.044586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:53.045021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:53.181185 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:53.188807 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-68533c4a-09d6-49e7-9f96-69c8e9113422 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1694 microversion: 2.1 time: 0.156785 Aug 01 15:22:53.189379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 455/883] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:53 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:53.564385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:53.564997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:53.572344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:53.572795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:53.573581 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:53.574019 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:53.636212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:53.645284 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:53.647846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:53.648530 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bdb76daf-e7e8-43da-93c8-5b48372d3b31 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1288 microversion: 2.20 time: 0.088041 Aug 01 15:22:53.649108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 429/884] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:53 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:54.211232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:54.211953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:54.218049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:54.218500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:54.219302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:54.219746 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:54.360618 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:54.368633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-aa7b3dac-98d8-4e12-be3b-3d2997d3b208 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1694 microversion: 2.1 time: 0.162069 Aug 01 15:22:54.369653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 456/885] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:54 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:54.672872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:54.673493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:54.681231 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:54.681681 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:54.682481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:54.682986 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:54.776759 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:54.785452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:54.787719 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:54.789251 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e941ebd5-1ae0-4541-a69d-bd40bff0d9cf tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1336 microversion: 2.20 time: 0.121287 Aug 01 15:22:54.789984 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 430/886] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:54 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:55.186117 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-155426ea-d5b7-4165-83b1-810f7fa28bb5 req-ba4b5db7-6312-421b-9d72-a2cf3200734a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e33525-a6db-4813-8a29-1c5a1c5b33eb", "name": "network-vif-deleted", "tag": "f47c057c-d9e2-4139-887f-aa554c5d32e5"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:55.197057 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-155426ea-d5b7-4165-83b1-810f7fa28bb5 req-ba4b5db7-6312-421b-9d72-a2cf3200734a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:55.197499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-155426ea-d5b7-4165-83b1-810f7fa28bb5 req-ba4b5db7-6312-421b-9d72-a2cf3200734a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:55.210853 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-155426ea-d5b7-4165-83b1-810f7fa28bb5 req-ba4b5db7-6312-421b-9d72-a2cf3200734a service nova] Creating event network-vif-deleted:f47c057c-d9e2-4139-887f-aa554c5d32e5 for instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb on hv-cinder-84327 Aug 01 15:22:55.219794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-155426ea-d5b7-4165-83b1-810f7fa28bb5 req-ba4b5db7-6312-421b-9d72-a2cf3200734a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037244 Aug 01 15:22:55.221501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 457/887] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:55.395058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:55.396834 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:55.408256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:55.408256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:55.408256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:55.408256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:55.442882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:55.443338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:55.443795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lazy-loading 'fault' on Instance uuid c7e33525-a6db-4813-8a29-1c5a1c5b33eb {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:22:55.503477 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:55.515765 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b278a1ba-7422-4980-af57-eaf1852e21f3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 200 len: 1339 microversion: 2.1 time: 0.127333 Aug 01 15:22:55.516522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 431/888] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:55 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:55.827996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:55.828935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:55.840444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:55.841031 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:55.841928 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:55.842599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:56.065844 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:56.074988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:56.077964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:56.079127 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0262dc2a-c823-4a82-82d5-8b4104c4ce2a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.255796 Aug 01 15:22:56.079689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 458/889] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:55 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:56.543997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:56.543997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c7e33525-a6db-4813-8a29-1c5a1c5b33eb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:56.549576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-e118c593-7bf4-44b5-a913-4cf56de90a12 req-14b82730-c46a-4a55-b80b-37b7ed24e456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:56.551547 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:56.552091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:56.553116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:56.553551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:56.561339 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-e118c593-7bf4-44b5-a913-4cf56de90a12 req-14b82730-c46a-4a55-b80b-37b7ed24e456 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:56.562214 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-e118c593-7bf4-44b5-a913-4cf56de90a12 req-14b82730-c46a-4a55-b80b-37b7ed24e456 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:56.569542 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] HTTP exception thrown: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb could not be found. Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Request method failure captured: Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb HTTP/1.1 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3iRa8nQuz8zJJ7zw4P6ORCW9wvF07J4tE_ci1BHwJVgFzKip30UyoE2M1ulTMJfh56fxizdNXnDDlcVxQtCyN9QzatO7rFkjIaEWa9yLtQ3G8GgCI796IsVloBdCYJ05MJ7CNX_dhWIhLF5oyNi3Rhk3mm7Vlv7JvTMnrC067Yxx4 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:22:56.571327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e5e42e0f0ef74615ac27486ada272fd8", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: ca1d32ee23bc42b38ea9a043f7a850f5 Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb could not be found. Aug 01 15:22:56.572877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'c7e33525-a6db-4813-8a29-1c5a1c5b33eb'} Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb could not be found. Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:22:56.573657 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb could not be found. Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb could not be found. Aug 01 15:22:56.575094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:22:56.576970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Returning 404 to user: Instance c7e33525-a6db-4813-8a29-1c5a1c5b33eb could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:22:56.576970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-78d1e9df-df5b-4e87-9160-b67726aeaf2a tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb" status: 404 len: 111 microversion: 2.1 time: 0.039236 Aug 01 15:22:56.577410 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 432/890] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:22:56 2022] GET /compute/v2.1/servers/c7e33525-a6db-4813-8a29-1c5a1c5b33eb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:22:56.582175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0b12ffc0-4b7d-4f2d-837a-cda936921393 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '.version_select at 0x7efd1cfefc10>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:56.583846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-e118c593-7bf4-44b5-a913-4cf56de90a12 req-14b82730-c46a-4a55-b80b-37b7ed24e456 service nova] Creating event network-changed:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:22:56.589954 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-e118c593-7bf4-44b5-a913-4cf56de90a12 req-14b82730-c46a-4a55-b80b-37b7ed24e456 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049285 Aug 01 15:22:56.590765 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 459/891] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:56.612711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0b12ffc0-4b7d-4f2d-837a-cda936921393 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140335652" status: 202 len: 0 microversion: 2.1 time: 0.034149 Aug 01 15:22:56.613293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 433/892] 10.222.0.100 () {58 vars in 1226 bytes} [Mon Aug 1 15:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140335652 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:22:57.104934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:57.105693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:57.112103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:57.112552 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:57.113334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:57.113763 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:57.446747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:57.455067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:57.456687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:57.457799 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ea299ff5-79d5-48e1-be30-8a3f9a561a3d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.358160 Aug 01 15:22:57.458474 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 460/893] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:57 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:58.481421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:58.482064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:58.490019 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:58.490469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:58.491275 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:58.491717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:58.622931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:58.631677 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:58.633174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:58.634290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f68e6f81-fac2-4e1b-9efd-6a5aa17b77e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.156864 Aug 01 15:22:58.634870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 434/894] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:58 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:59.657703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:59.658328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:59.660785 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.661477 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=8 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:59.667830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:59.668303 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:59.669086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:59.669528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:59.800530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:59.810729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:59.812353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:59.813480 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0fe72128-3b4d-41d5-9155-2221236aa76a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.159911 Aug 01 15:22:59.814044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 461/895] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:22:59 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:23:00.043412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:00.044052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.051071 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.051442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.052731 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.053167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.072201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.082551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:00.318967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d76589b5-9d7f-4895-a2bd-144ace202154 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "DELETE /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 204 len: 0 microversion: 2.1 time: 0.279066 Aug 01 15:23:00.319500 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 435/896] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:23:00 2022] DELETE /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:00.329303 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:00.329912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.336023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.336471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.337454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.337893 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.342116 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.481660 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:00.489944 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-48571f8f-73e1-44f4-9991-7e128753fbb9 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1513 microversion: 2.1 time: 0.164760 Aug 01 15:23:00.490518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 462/897] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:00 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:00.837321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:00.837949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.844454 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.845093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.845926 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.846434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.976165 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:00.984053 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:00.985588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:00.986702 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-56c9da31-dfb6-44ed-a8c5-dd27448200c6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.154404 Aug 01 15:23:00.987235 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 436/898] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:23:00 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:23:01.511305 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:01.511852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:01.518320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:01.518800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:01.519647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:01.520140 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:01.613145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:01.623793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-073608fd-8a6a-412d-b461-1871883d8da3 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 200 len: 1471 microversion: 2.1 time: 0.116485 Aug 01 15:23:01.624378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 463/899] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:01 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 1471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:01.662961 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f0d984e8-06a2-4f7e-adcc-655e54a7a79f req-2328eebb-479a-4e56-92ed-aec9bd8decf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf0433e-acd3-4be5-9bd6-af6c2851084b", "name": "network-vif-deleted", "tag": "fed91c7f-477d-4a1c-a51a-755932302fbd"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:01.673031 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f0d984e8-06a2-4f7e-adcc-655e54a7a79f req-2328eebb-479a-4e56-92ed-aec9bd8decf8 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:01.673478 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f0d984e8-06a2-4f7e-adcc-655e54a7a79f req-2328eebb-479a-4e56-92ed-aec9bd8decf8 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:01.684692 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f0d984e8-06a2-4f7e-adcc-655e54a7a79f req-2328eebb-479a-4e56-92ed-aec9bd8decf8 service nova] Creating event network-vif-deleted:fed91c7f-477d-4a1c-a51a-755932302fbd for instance bbf0433e-acd3-4be5-9bd6-af6c2851084b on hv-cinder-84327 Aug 01 15:23:01.690856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f0d984e8-06a2-4f7e-adcc-655e54a7a79f req-2328eebb-479a-4e56-92ed-aec9bd8decf8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Aug 01 15:23:01.691703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 437/900] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:02.010796 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:02.011411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:02.019063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.019515 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.020326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.021330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.171828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:02.189830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:02.194593 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:02.196783 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-74f3a1ff-eab9-46a1-ae85-eec8d1ff5c0c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.189769 Aug 01 15:23:02.198113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 464/901] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:23:02 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:23:02.641962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=10 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:02.646927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:02.647623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: bbf0433e-acd3-4be5-9bd6-af6c2851084b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:02.654072 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.654511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.655295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.655725 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.669156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] HTTP exception thrown: Instance bbf0433e-acd3-4be5-9bd6-af6c2851084b could not be found. Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Request method failure captured: Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b HTTP/1.1 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3iRa8nQuz8zJJ7zw4P6ORCW9wvF07J4tE_ci1BHwJVgFzKip30UyoE2M1ulTMJfh56fxizdNXnDDlcVxQtCyN9QzatO7rFkjIaEWa9yLtQ3G8GgCI796IsVloBdCYJ05MJ7CNX_dhWIhLF5oyNi3Rhk3mm7Vlv7JvTMnrC067Yxx4 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:23:02.670849 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e5e42e0f0ef74615ac27486ada272fd8", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: ca1d32ee23bc42b38ea9a043f7a850f5 Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance bbf0433e-acd3-4be5-9bd6-af6c2851084b could not be found. Aug 01 15:23:02.672441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'bbf0433e-acd3-4be5-9bd6-af6c2851084b'} Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf0433e-acd3-4be5-9bd6-af6c2851084b could not be found. Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:02.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf0433e-acd3-4be5-9bd6-af6c2851084b could not be found. Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf0433e-acd3-4be5-9bd6-af6c2851084b could not be found. Aug 01 15:23:02.675069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:02.676806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Returning 404 to user: Instance bbf0433e-acd3-4be5-9bd6-af6c2851084b could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:02.676806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7c48ddbc-e3fe-4d7f-8318-e80b20253a36 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b" status: 404 len: 111 microversion: 2.1 time: 0.031365 Aug 01 15:23:02.676806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 438/902] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:02 2022] GET /compute/v2.1/servers/bbf0433e-acd3-4be5-9bd6-af6c2851084b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:02.680951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:02.681443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:02.688194 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.688639 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.689401 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.689862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.716975 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:02.789844 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5bd58b39-da78-4ad6-96b5-13d78c3bd7d8 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 204 len: 0 microversion: 2.1 time: 0.112514 Aug 01 15:23:02.790441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 465/903] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:23:02 2022] DELETE /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:02.802534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:02.803611 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:02.811769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.811769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.812092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.812439 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.950063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:02.958067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58f1cacc-1b8a-42a4-86d8-bf9504058dfe tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.163079 Aug 01 15:23:02.958608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 439/904] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:02 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:03.221786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:03.222489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:03.229376 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:03.229822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:03.230590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:03.231047 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:03.363335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:03.371481 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:03.372977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:03.374101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a722dd79-febc-446b-8727-2ad77ad5bbc7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.156628 Aug 01 15:23:03.374653 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 466/905] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:23:03 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:23:03.979070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:03.979730 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:03.987318 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:03.987770 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:03.988544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:03.988978 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.179833 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1d32ee23bc42b38ea9a043f7a850f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e42e0f0ef74615ac27486ada272fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:04.187634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5fa3b636-8ea1-4484-90da-d14753c02847 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 200 len: 1526 microversion: 2.1 time: 0.212611 Aug 01 15:23:04.188275 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 440/906] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:03 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 1526 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:04.300031 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-ceba2a54-1ada-42ee-a95a-76c4f1e32a8a req-e9b6e3d2-5425-4593-8c62-66e089b76faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40bc31b-5c78-49e5-99ea-0cc891add3c4", "name": "network-vif-deleted", "tag": "d51788c4-39dd-4128-bdbc-fb2980d56261"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:04.315920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-ceba2a54-1ada-42ee-a95a-76c4f1e32a8a req-e9b6e3d2-5425-4593-8c62-66e089b76faf service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:04.316727 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-ceba2a54-1ada-42ee-a95a-76c4f1e32a8a req-e9b6e3d2-5425-4593-8c62-66e089b76faf service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.342322 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-ceba2a54-1ada-42ee-a95a-76c4f1e32a8a req-e9b6e3d2-5425-4593-8c62-66e089b76faf service nova] Creating event network-vif-deleted:d51788c4-39dd-4128-bdbc-fb2980d56261 for instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 on hv-cinder-84327 Aug 01 15:23:04.349042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-ceba2a54-1ada-42ee-a95a-76c4f1e32a8a req-e9b6e3d2-5425-4593-8c62-66e089b76faf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052673 Aug 01 15:23:04.349735 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 467/907] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:04.392172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-1eb3fc91-fc89-4feb-9210-9b3c0b0d485f req-f3fae915-c805-4b7d-a829-b4bd82be9bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "name": "network-vif-plugged", "status": "completed", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:04.400849 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:04.401599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:04.405185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-1eb3fc91-fc89-4feb-9210-9b3c0b0d485f req-f3fae915-c805-4b7d-a829-b4bd82be9bcd service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:04.405816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-1eb3fc91-fc89-4feb-9210-9b3c0b0d485f req-f3fae915-c805-4b7d-a829-b4bd82be9bcd service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.408216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:04.408883 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.409662 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:04.410101 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.419845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-1eb3fc91-fc89-4feb-9210-9b3c0b0d485f req-f3fae915-c805-4b7d-a829-b4bd82be9bcd service nova] Creating event network-vif-plugged:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:23:04.426217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-1eb3fc91-fc89-4feb-9210-9b3c0b0d485f req-f3fae915-c805-4b7d-a829-b4bd82be9bcd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040953 Aug 01 15:23:04.427887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 441/908] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:04.554471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:04.562518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:04.564121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:04.565242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f070d497-e363-45cb-ad47-05f3a11d7a55 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.171021 Aug 01 15:23:04.565795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 468/909] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:23:04 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:23:05.211790 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:05.212389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] [instance: c40bc31b-5c78-49e5-99ea-0cc891add3c4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:05.218812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.219258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.220008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.220436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.233982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] HTTP exception thrown: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 could not be found. Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Request method failure captured: Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 HTTP/1.1 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3iRa8nQuz8zJJ7zw4P6ORCW9wvF07J4tE_ci1BHwJVgFzKip30UyoE2M1ulTMJfh56fxizdNXnDDlcVxQtCyN9QzatO7rFkjIaEWa9yLtQ3G8GgCI796IsVloBdCYJ05MJ7CNX_dhWIhLF5oyNi3Rhk3mm7Vlv7JvTMnrC067Yxx4 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:23:05.235623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e5e42e0f0ef74615ac27486ada272fd8", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e5e42e0f0ef74615ac27486ada272fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e5e42e0f0ef74615ac27486ada272fd8 Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760785823 Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: ca1d32ee23bc42b38ea9a043f7a850f5 Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760785823-project Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 could not be found. Aug 01 15:23:05.237166 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'c40bc31b-5c78-49e5-99ea-0cc891add3c4'} Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 could not be found. Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:05.238075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 could not be found. Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 could not be found. Aug 01 15:23:05.239590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:23:05.240894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] Returning 404 to user: Instance c40bc31b-5c78-49e5-99ea-0cc891add3c4 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:05.240894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-42843ad8-95fb-40c0-999f-b0cb66f74113 tempest-ServerRescueNegativeTestJSON-760785823 tempest-ServerRescueNegativeTestJSON-760785823-project] 10.222.0.100 "GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4" status: 404 len: 111 microversion: 2.1 time: 0.030624 Aug 01 15:23:05.240894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 442/910] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:05 2022] GET /compute/v2.1/servers/c40bc31b-5c78-49e5-99ea-0cc891add3c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:05.589554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:05.590165 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:05.596716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.597157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.597916 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.598377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.824845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:05.834006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:05.835632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:05.836766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0728bd05-c1f6-440e-a4ca-d57fd27dafdd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1409 microversion: 2.20 time: 0.251189 Aug 01 15:23:05.837327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 469/911] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:23:05 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1409 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:23:06.859774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:06.860395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:06.867774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:06.868223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:06.869003 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:06.869443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.184353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:07.192498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:07.194103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:07.195399 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ade4313b-4735-4cd2-b5cf-9da3dcc16453 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1601 microversion: 2.20 time: 0.339572 Aug 01 15:23:07.196343 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 443/912] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:23:06 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1601 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:23:07.217878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:07.218443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:07.226150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:07.226605 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.227413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:07.227854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.314947 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bde7eeb9-30e0-4e05-bded-8f49ad228b20 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100967 Aug 01 15:23:07.318747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 470/913] 10.222.0.100 () {60 vars in 1321 bytes} [Mon Aug 1 15:23:07 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:23:09.019776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-22fb6b5c-2c8b-4541-a4a7-946850b950a6 req-d8029929-4790-4e61-8632-68f6f5b8b761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:09.030960 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-22fb6b5c-2c8b-4541-a4a7-946850b950a6 req-d8029929-4790-4e61-8632-68f6f5b8b761 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:09.031412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-22fb6b5c-2c8b-4541-a4a7-946850b950a6 req-d8029929-4790-4e61-8632-68f6f5b8b761 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:09.043322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-22fb6b5c-2c8b-4541-a4a7-946850b950a6 req-d8029929-4790-4e61-8632-68f6f5b8b761 service nova] Creating event network-changed:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:23:09.048764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-22fb6b5c-2c8b-4541-a4a7-946850b950a6 req-d8029929-4790-4e61-8632-68f6f5b8b761 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032571 Aug 01 15:23:09.049613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 444/914] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:15.176782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fd62f999-17bc-467f-9cec-dfcc8babc004 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: .version_select at 0x7efd21821700>, body: {"keypair": {"name": "tempest-keypair-370080721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzY4Nz8mwdBQ2ZOxDzPtjrfZ33ZZK8DawURjKgtVjQQr7Licj0EtldHCjii/braAOgp9rPNMWFwRZT4cD0yozNC87008IyiMnvMXQQtC6pysTyIRlOeS+4xtpXOIo1TBA=="}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:15.182532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:15.197352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-fd62f999-17bc-467f-9cec-dfcc8babc004 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:15.202461 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-fd62f999-17bc-467f-9cec-dfcc8babc004 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:15.228242 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fd62f999-17bc-467f-9cec-dfcc8babc004 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.220778 Aug 01 15:23:15.228833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 471/915] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:23:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:16.551180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1754569914", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64714ec3-4fee-42c0-bc82-5b770c41babf"}], "security_groups": [{"name": "tempest-securitygroup--1294450424"}], "key_name": "tempest-keypair-370080721", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:16.560007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:16.656027 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] validate_networks() for [('64714ec3-4fee-42c0-bc82-5b770c41babf', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:23:17.077052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:23:17.077474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:23:17.077944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:23:17.078350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:23:17.078793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:23:17.088349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:17.088727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:17.089524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:17.089955 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:17.106989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:17.110939 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:17.122332 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:23:17.124717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:23:17.171820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b55d7640-7044-4145-9c1c-7794a6cd6e26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.625300 Aug 01 15:23:17.172559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 445/916] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:23:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:23:17.184870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e198b04a-7f42-4c16-bbb1-844f04bcf541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:17.186446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e198b04a-7f42-4c16-bbb1-844f04bcf541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:17.244688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e198b04a-7f42-4c16-bbb1-844f04bcf541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:17.248531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:17.253909 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e198b04a-7f42-4c16-bbb1-844f04bcf541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1245 microversion: 2.1 time: 0.073574 Aug 01 15:23:17.254684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 472/917] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:17 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:18.278441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:18.280056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:18.290925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:18.291701 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:18.292651 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:18.293138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:18.696863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:18.708636 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e9d67cdc-f9f1-4fc6-bf9a-0db434d4cc6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1305 microversion: 2.1 time: 0.435750 Aug 01 15:23:18.709386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 446/918] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:18 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1305 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:19.729780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:19.730431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:19.737865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:19.738315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:19.739108 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:19.739545 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:19.957407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:19.965707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-43ce6893-fff2-4989-b76e-829bf1039baf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.240198 Aug 01 15:23:19.966367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 473/919] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:19 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:20.045123 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-ffd83361-a305-4d65-8b53-dc5367cfcc86 req-76b3c7f4-d571-4975-9ef3-d5ecadb8be5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50fe1da9-6f4b-4843-ab47-523d01773f03", "tag": "75f05372-caf7-4de3-b9f9-38fad2b1a78c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:20.058345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ffd83361-a305-4d65-8b53-dc5367cfcc86 req-76b3c7f4-d571-4975-9ef3-d5ecadb8be5e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:20.059287 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ffd83361-a305-4d65-8b53-dc5367cfcc86 req-76b3c7f4-d571-4975-9ef3-d5ecadb8be5e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:20.074360 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-ffd83361-a305-4d65-8b53-dc5367cfcc86 req-76b3c7f4-d571-4975-9ef3-d5ecadb8be5e service nova] Creating event network-changed:75f05372-caf7-4de3-b9f9-38fad2b1a78c for instance 50fe1da9-6f4b-4843-ab47-523d01773f03 on hv-cinder-84327 Aug 01 15:23:20.080122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-ffd83361-a305-4d65-8b53-dc5367cfcc86 req-76b3c7f4-d571-4975-9ef3-d5ecadb8be5e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039037 Aug 01 15:23:20.080746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 447/920] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:20.986654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:20.987225 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:20.994232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:20.994703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:20.995472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:20.995906 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:21.127260 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:21.136160 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-94e27abf-e4c4-4190-bb70-3a88892146c3 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.153384 Aug 01 15:23:21.136722 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 474/921] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:20 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:21.933086 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1684994932"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:21.934194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:21.940989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:21.941785 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:21.943688 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:21.944439 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:22.073911 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.network.security_group_api [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Removing security group f9385c48-9d4a-4ff5-b79b-574d1c0025bf from port 47488f03-2d13-4e5e-a010-d1a9d89ebab6 Aug 01 15:23:22.156885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:22.157535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:22.164046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:22.164488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:22.165253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:22.165690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:22.380848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:22.388550 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8d5bfb48-3470-4c3b-9f15-84a0e79ec739 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.235598 Aug 01 15:23:22.389102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 475/922] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:22 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:22.464482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e37b52af-0e8d-4b02-b4f7-6b7b8114305e tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/action" status: 202 len: 0 microversion: 2.1 time: 0.536213 Aug 01 15:23:22.465084 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 448/923] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:23:21 2022] POST /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:22.481314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-f9d2ea3e-7b4c-439c-a710-08666898097f req-36f5332b-3696-4a1d-9b82-1c362b7abcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:22.493420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-f9d2ea3e-7b4c-439c-a710-08666898097f req-36f5332b-3696-4a1d-9b82-1c362b7abcf7 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:22.493420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-f9d2ea3e-7b4c-439c-a710-08666898097f req-36f5332b-3696-4a1d-9b82-1c362b7abcf7 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:22.505514 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-f9d2ea3e-7b4c-439c-a710-08666898097f req-36f5332b-3696-4a1d-9b82-1c362b7abcf7 service nova] Creating event network-changed:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:23:22.510921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-f9d2ea3e-7b4c-439c-a710-08666898097f req-36f5332b-3696-4a1d-9b82-1c362b7abcf7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033411 Aug 01 15:23:22.511968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 476/924] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:23.409860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:23.411678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:23.417898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.418347 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.419176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.419648 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.597200 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:23.598046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:23.605231 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.605693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.606472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.606939 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.690533 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:23.702352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4a83c10b-b858-4b54-9811-c88b3960d6e5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.296733 Aug 01 15:23:23.709342 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lazy-loading 'services' on Instance uuid 94c4d546-4216-463a-831c-a5bfbb9712bd {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:23:23.715839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 449/925] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:23 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:23.798862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a0e65f8f-3198-4247-b401-17339e547964 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments/99ea8f89-cebd-4b85-92d6-50825d034dd9" status: 202 len: 0 microversion: 2.1 time: 0.205846 Aug 01 15:23:23.800264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 477/926] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:23:23 2022] DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments/99ea8f89-cebd-4b85-92d6-50825d034dd9 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:23.809155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:23.811946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:23.822018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.823431 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.825105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.825721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.880579 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e6aca731-fd6d-406f-ab20-a67e20d07c0a tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074921 Aug 01 15:23:23.881155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 450/927] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:23:23 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:24.531457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-5a1e7553-5c29-4e83-97bb-88dd768a5f91 req-103e02e7-6959-4a64-89b8-b78b498a8cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:24.554469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5a1e7553-5c29-4e83-97bb-88dd768a5f91 req-103e02e7-6959-4a64-89b8-b78b498a8cd0 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.554962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5a1e7553-5c29-4e83-97bb-88dd768a5f91 req-103e02e7-6959-4a64-89b8-b78b498a8cd0 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.577252 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-5a1e7553-5c29-4e83-97bb-88dd768a5f91 req-103e02e7-6959-4a64-89b8-b78b498a8cd0 service nova] Creating event network-changed:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:23:24.587073 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-5a1e7553-5c29-4e83-97bb-88dd768a5f91 req-103e02e7-6959-4a64-89b8-b78b498a8cd0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061483 Aug 01 15:23:24.588106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 478/928] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:24.725877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:24.726491 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:24.734259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.734741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.735521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.735958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.877794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:24.885306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-04294eee-5fc1-472c-ae78-f878bdcd5ba1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.163899 Aug 01 15:23:24.885903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 451/929] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:24 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:24.895090 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:24.897875 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:24.909800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.910253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.911636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.912079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.943707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e8b30b83-c4e4-4fc5-8915-2f6fb5321f5c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053965 Aug 01 15:23:24.944195 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 479/930] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:23:24 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:25.907290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:25.907899 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:25.914464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:25.915090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:25.915854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:25.916291 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:25.955931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:25.958790 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:25.965382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:25.965834 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:25.966605 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:25.967068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:25.995309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-14db273d-a0a2-4b87-8445-7a7ad96da90d tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043303 Aug 01 15:23:25.995867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 480/931] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:23:25 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:23:26.006470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:26.007067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:26.013952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:26.014553 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:26.015206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:26.015643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:26.050598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:26.060384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6b916a87-0f3a-4749-98ce-800e793e774f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.156977 Aug 01 15:23:26.060946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 452/932] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:25 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:26.090887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] HTTP exception thrown: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd is not attached to volume 99ea8f89-cebd-4b85-92d6-50825d034dd9 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Request method failure captured: Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments/99ea8f89-cebd-4b85-92d6-50825d034dd9 HTTP/1.1 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-78OD8cafAH9VtHPF2_4dDDWBzcgoLzuxpQwo9Z5zyLCJxHHzpap61p1xPxjB6YbIcisRNsODMAdppBI5zzUrlwqNb_Ga8uJNvIWHd7XaxWTovIIq2pPqwhIC0yhOnFJlFnAAPZgVou5mlXkaAUyrYU0sTt6SPEP_cj7oMJQfd5Ck4 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: f9c87c7cbcb5481db04aaa2a494be32d Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestMinimumBasicScenario-1838156819 Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:23:26.093263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f9c87c7cbcb5481db04aaa2a494be32d", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f9c87c7cbcb5481db04aaa2a494be32d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f9c87c7cbcb5481db04aaa2a494be32d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f9c87c7cbcb5481db04aaa2a494be32d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestMinimumBasicScenario-1838156819 Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: f9c87c7cbcb5481db04aaa2a494be32d Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1838156819 Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestMinimumBasicScenario-1838156819-project Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: c95c223146c94cd29850744a208ed60d Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestMinimumBasicScenario-1838156819-project Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:23:26.094903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd is not attached to volume 99ea8f89-cebd-4b85-92d6-50825d034dd9 Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'server_id': '94c4d546-4216-463a-831c-a5bfbb9712bd', 'id': '99ea8f89-cebd-4b85-92d6-50825d034dd9'} Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 99ea8f89-cebd-4b85-92d6-50825d034dd9. Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:26.095710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd is not attached to volume 99ea8f89-cebd-4b85-92d6-50825d034dd9 Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd is not attached to volume 99ea8f89-cebd-4b85-92d6-50825d034dd9 Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:26.096993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Returning 404 to user: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd is not attached to volume 99ea8f89-cebd-4b85-92d6-50825d034dd9 {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:26.098141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3e84a5ed-fc2c-4a0e-8a33-8cb7c44452a6 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments/99ea8f89-cebd-4b85-92d6-50825d034dd9" status: 404 len: 154 microversion: 2.1 time: 0.092639 Aug 01 15:23:26.098141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 481/933] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:23:26 2022] DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd/os-volume_attachments/99ea8f89-cebd-4b85-92d6-50825d034dd9 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:26.319888 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d5587748-2b6c-43fd-9cc0-b3d94bc9ac68 req-66354ab1-90e6-463d-a152-5db9ca98b61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50fe1da9-6f4b-4843-ab47-523d01773f03", "name": "network-vif-plugged", "status": "completed", "tag": "75f05372-caf7-4de3-b9f9-38fad2b1a78c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:26.329494 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d5587748-2b6c-43fd-9cc0-b3d94bc9ac68 req-66354ab1-90e6-463d-a152-5db9ca98b61c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:26.329936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d5587748-2b6c-43fd-9cc0-b3d94bc9ac68 req-66354ab1-90e6-463d-a152-5db9ca98b61c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:26.341581 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d5587748-2b6c-43fd-9cc0-b3d94bc9ac68 req-66354ab1-90e6-463d-a152-5db9ca98b61c service nova] Creating event network-vif-plugged:75f05372-caf7-4de3-b9f9-38fad2b1a78c for instance 50fe1da9-6f4b-4843-ab47-523d01773f03 on hv-cinder-84327 Aug 01 15:23:26.348450 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d5587748-2b6c-43fd-9cc0-b3d94bc9ac68 req-66354ab1-90e6-463d-a152-5db9ca98b61c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Aug 01 15:23:26.349968 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 453/934] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:27.081702 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:27.082311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:27.089364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.089810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.090567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.091041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.229163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:27.233197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.234061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.237353 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f1c5dc43-1791-4e76-ba45-09e0aa275059 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.159444 Aug 01 15:23:27.237922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 482/935] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:27 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:27.238142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:27.238765 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:27.246141 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.246599 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.247401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.247841 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.272995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:27.315295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.346561 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ed830851-502d-4e3c-b78c-5a402ed1d3ae tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 204 len: 0 microversion: 2.1 time: 0.114483 Aug 01 15:23:27.347192 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 454/936] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:23:27 2022] DELETE /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:27.355835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:27.356441 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:27.358381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:27.364170 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.364617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.365378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.365812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.494436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:27.502049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2fa3a942-fb37-4447-a28b-6eff4e2df78c tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1558 microversion: 2.1 time: 0.150313 Aug 01 15:23:27.502612 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 483/937] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:27 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:28.259348 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:28.260187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:28.266566 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.267049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.267813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.268286 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.398256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:28.405680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dfa11705-de76-4436-904c-a4e9dab76cc6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.151422 Aug 01 15:23:28.406242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 455/938] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:28 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:28.526877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:28.527707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:28.534085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.534526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.535334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.535766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.666915 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:28.674331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-12244725-6d3f-4acf-8b5c-a95cf3897133 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1558 microversion: 2.1 time: 0.153687 Aug 01 15:23:28.674907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 484/939] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:28 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:29.425562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:29.426197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:29.432742 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:29.433189 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:29.433953 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:29.434392 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:29.561741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:29.569718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-547319ac-8327-4961-9446-752706084eae tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1371 microversion: 2.1 time: 0.147622 Aug 01 15:23:29.570276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 456/940] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:29 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:29.696528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:29.697054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:29.704275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:29.704731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:29.705501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:29.705941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:29.842497 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:29.858498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fc2ed6c8-f9f8-4af1-b00d-62e32496219f tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1558 microversion: 2.1 time: 0.166393 Aug 01 15:23:29.859191 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 485/941] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:29 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:30.591228 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:30.591877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:30.598481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.598966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.599741 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.600180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.686542 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:30.688804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:30.694826 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.695277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.696038 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.696483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.726262 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d7fba14c-108a-418c-9ab4-4d8111f06904 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042925 Aug 01 15:23:30.727169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 486/942] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:23:30 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 15:23:30.731916 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:30.739681 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a0577cb0-5edd-4b7d-9b43-605d2ffca3ba tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1560 microversion: 2.1 time: 0.152348 Aug 01 15:23:30.740529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 457/943] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:30 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:30.760419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:30.760828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:30.766835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.767285 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.768049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.768492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.791683 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:30.792174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:30.798164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.798548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.799335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.799769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.826941 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:30.852337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-761e4e6c-8cdc-4e10-9547-9aa4b6783541 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096401 Aug 01 15:23:30.853646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 487/944] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:23:30 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:30.880087 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:30.880699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:30.887698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.888139 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.888912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.889357 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.910152 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-722f8d02-ec6a-4672-8989-1699ab2e1da7 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 204 len: 0 microversion: 2.1 time: 0.123555 Aug 01 15:23:30.911248 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 458/945] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:23:30 2022] DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:23:30.919444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:30.920156 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:30.927198 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.927737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.928551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:30.928982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:31.243672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:31.251099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1e7d72dc-9c35-462a-83bc-8a9b0e1fb8e4 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1558 microversion: 2.1 time: 0.374727 Aug 01 15:23:31.264870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 488/946] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:30 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1558 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:31.265104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:31.271595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ba4c9edf-5947-41ff-af67-2358b8db7483 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1675 microversion: 2.1 time: 0.355962 Aug 01 15:23:31.273066 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 459/947] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:30 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1675 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:32.177207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-d14a86c7-b544-44cb-b6e3-a622659756a9 req-e409892e-937f-4a8e-a9b3-de041be906a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50fe1da9-6f4b-4843-ab47-523d01773f03", "tag": "75f05372-caf7-4de3-b9f9-38fad2b1a78c"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:32.187533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d14a86c7-b544-44cb-b6e3-a622659756a9 req-e409892e-937f-4a8e-a9b3-de041be906a7 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.187976 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d14a86c7-b544-44cb-b6e3-a622659756a9 req-e409892e-937f-4a8e-a9b3-de041be906a7 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.200508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-d14a86c7-b544-44cb-b6e3-a622659756a9 req-e409892e-937f-4a8e-a9b3-de041be906a7 service nova] Creating event network-changed:75f05372-caf7-4de3-b9f9-38fad2b1a78c for instance 50fe1da9-6f4b-4843-ab47-523d01773f03 on hv-cinder-84327 Aug 01 15:23:32.205336 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-d14a86c7-b544-44cb-b6e3-a622659756a9 req-e409892e-937f-4a8e-a9b3-de041be906a7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Aug 01 15:23:32.206243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 489/948] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:32.272637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:32.273254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:32.279711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.280165 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.281168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.281606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.295417 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:32.296426 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:32.302892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.304109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.304885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.305328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.499124 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:32.508233 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-34cc02c1-5ade-402d-9688-301365388488 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1558 microversion: 2.1 time: 0.239597 Aug 01 15:23:32.509074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 460/949] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:32 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:32.524605 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:32.532716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8f7184c0-3164-4204-a1e3-3262d00909b3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1675 microversion: 2.1 time: 0.242966 Aug 01 15:23:32.533586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 490/950] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:32 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:32.753477 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-ccb21679-6681-4da4-ae9b-848aaeb2586d req-8e93bd5c-8fdc-443c-8117-557ecae9404d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c4d546-4216-463a-831c-a5bfbb9712bd", "name": "network-vif-deleted", "tag": "47488f03-2d13-4e5e-a010-d1a9d89ebab6"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:32.763860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ccb21679-6681-4da4-ae9b-848aaeb2586d req-8e93bd5c-8fdc-443c-8117-557ecae9404d service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.764387 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ccb21679-6681-4da4-ae9b-848aaeb2586d req-8e93bd5c-8fdc-443c-8117-557ecae9404d service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.775430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-ccb21679-6681-4da4-ae9b-848aaeb2586d req-8e93bd5c-8fdc-443c-8117-557ecae9404d service nova] Creating event network-vif-deleted:47488f03-2d13-4e5e-a010-d1a9d89ebab6 for instance 94c4d546-4216-463a-831c-a5bfbb9712bd on hv-cinder-84327 Aug 01 15:23:32.780433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-ccb21679-6681-4da4-ae9b-848aaeb2586d req-8e93bd5c-8fdc-443c-8117-557ecae9404d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Aug 01 15:23:32.781102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 461/951] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:33.531324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:33.531987 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:33.542830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:33.543285 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:33.547570 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:33.548266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:33.552986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:33.554646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:33.555412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:33.564780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:33.567125 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:33.573118 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:33.573941 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:33.588891 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:33.589670 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:33.590364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lazy-loading 'fault' on Instance uuid 94c4d546-4216-463a-831c-a5bfbb9712bd {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:23:33.657356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95c223146c94cd29850744a208ed60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c87c7cbcb5481db04aaa2a494be32d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:33.666311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-762b8963-8984-48cc-b581-5c7f80104827 tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 200 len: 1353 microversion: 2.1 time: 0.140069 Aug 01 15:23:33.673766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 491/952] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:33 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:33.761580 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:33.769351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b11d0db8-98c2-4259-b2da-2f667ef4f5ad tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 200 len: 1675 microversion: 2.1 time: 0.219054 Aug 01 15:23:33.769924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 462/953] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:33 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:34.687621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:34.688241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] [instance: 94c4d546-4216-463a-831c-a5bfbb9712bd] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:34.694915 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.695364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.696136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.696569 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.710469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] HTTP exception thrown: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd could not be found. Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Request method failure captured: Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd HTTP/1.1 Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-78OD8cafAH9VtHPF2_4dDDWBzcgoLzuxpQwo9Z5zyLCJxHHzpap61p1xPxjB6YbIcisRNsODMAdppBI5zzUrlwqNb_Ga8uJNvIWHd7XaxWTovIIq2pPqwhIC0yhOnFJlFnAAPZgVou5mlXkaAUyrYU0sTt6SPEP_cj7oMJQfd5Ck4 Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: f9c87c7cbcb5481db04aaa2a494be32d Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestMinimumBasicScenario-1838156819 Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:23:34.712150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f9c87c7cbcb5481db04aaa2a494be32d", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f9c87c7cbcb5481db04aaa2a494be32d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f9c87c7cbcb5481db04aaa2a494be32d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f9c87c7cbcb5481db04aaa2a494be32d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestMinimumBasicScenario-1838156819 Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: f9c87c7cbcb5481db04aaa2a494be32d Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1838156819 Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestMinimumBasicScenario-1838156819-project Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: c95c223146c94cd29850744a208ed60d Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestMinimumBasicScenario-1838156819-project Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd could not be found. Aug 01 15:23:34.713599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '94c4d546-4216-463a-831c-a5bfbb9712bd'} Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd could not be found. Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:34.714394 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd could not be found. Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd could not be found. Aug 01 15:23:34.715814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.717650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Returning 404 to user: Instance 94c4d546-4216-463a-831c-a5bfbb9712bd could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:34.717650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ca27a093-2981-42b7-809c-099f463aca0b tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd" status: 404 len: 111 microversion: 2.1 time: 0.029801 Aug 01 15:23:34.717650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 492/954] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:34 2022] GET /compute/v2.1/servers/94c4d546-4216-463a-831c-a5bfbb9712bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:34.722946 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2eae0b40-eb42-441c-b44b-867b239e40ea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] Calling method '.version_select at 0x7efd1d180dc0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:34.743349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2eae0b40-eb42-441c-b44b-867b239e40ea tempest-TestMinimumBasicScenario-1838156819 tempest-TestMinimumBasicScenario-1838156819-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1253813154" status: 202 len: 0 microversion: 2.1 time: 0.024194 Aug 01 15:23:34.743919 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 463/955] 10.222.0.100 () {58 vars in 1277 bytes} [Mon Aug 1 15:23:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1253813154 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:34.795194 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:34.796083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:34.798791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-02440fe8-1f61-45a1-ab1d-7ae7425f3bed req-da24c71f-0b4e-4756-9c14-cab0d5ca15b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d7106b-88eb-481b-aa10-bbfffc0cd9f0", "name": "network-vif-deleted", "tag": "afd70030-3dda-4c22-8097-6ed169808ee0"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:34.804853 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.805981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.807634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.808602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.809771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-02440fe8-1f61-45a1-ab1d-7ae7425f3bed req-da24c71f-0b4e-4756-9c14-cab0d5ca15b1 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.810216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-02440fe8-1f61-45a1-ab1d-7ae7425f3bed req-da24c71f-0b4e-4756-9c14-cab0d5ca15b1 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.821828 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-02440fe8-1f61-45a1-ab1d-7ae7425f3bed req-da24c71f-0b4e-4756-9c14-cab0d5ca15b1 service nova] Creating event network-vif-deleted:afd70030-3dda-4c22-8097-6ed169808ee0 for instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 on hv-cinder-84327 Aug 01 15:23:34.826987 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-02440fe8-1f61-45a1-ab1d-7ae7425f3bed req-da24c71f-0b4e-4756-9c14-cab0d5ca15b1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031888 Aug 01 15:23:34.827767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 464/956] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:34.839818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] HTTP exception thrown: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Request method failure captured: Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 HTTP/1.1 Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kflepw2ropyaTxQ9Jd8mBhUpW3Vvvj9nbn6nbkDzBdYgXU7y6-NcWnTBocu_LBLQW3JhYApM9Zj0Locrv37VZwR-EbQE-I9jycqb0gBOQaQldcDWFLfnYqUSQdpbzMVA6d-ZkjDFGWAzT7bz4jla7V0BJzTHCSGTBMI1_XylKJNE Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:23:34.845098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_18f123f171554a58a2dea8fcc2afbefd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: f33ea26c1f72445bb4cb50ea503600dc Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:23:34.847887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'e6d7106b-88eb-481b-aa10-bbfffc0cd9f0'} Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:34.849272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:23:34.851600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:23:34.854258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Returning 404 to user: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:34.854258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-351186a5-fbce-4f88-8980-24d9ca01d45d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 404 len: 111 microversion: 2.1 time: 0.059874 Aug 01 15:23:34.854258 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 493/957] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:34 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:34.859444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea118663-5556-4212-bbf3-094c87dc2460 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '.version_select at 0x7efd1d2464c0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:34.879483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea118663-5556-4212-bbf3-094c87dc2460 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878869037" status: 202 len: 0 microversion: 2.1 time: 0.024207 Aug 01 15:23:34.880100 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 465/958] 10.222.0.100 () {58 vars in 1226 bytes} [Mon Aug 1 15:23:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878869037 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:35.570459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-00c8c406-edff-4ff3-9351-756b0298dfd1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: .version_select at 0x7efd217cf1f0>, body: {"keypair": {"name": "tempest-keypair-1314252279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUaQBeWRZQWL1lxRk1gSYpUQXkEtEX8iJzIuqS2UumpHtLkGirow2JO53nHF8M3Z7b1q8SlVjXLyy4+xTIEmC7roRQWl5oc3kvxweCxKDWIPuvMC4hTxKHEQdXHF0MeWw=="}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:35.586583 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-00c8c406-edff-4ff3-9351-756b0298dfd1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:35.590498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-00c8c406-edff-4ff3-9351-756b0298dfd1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for user f33ea26c1f72445bb4cb50ea503600dc and project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:35.612654 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-00c8c406-edff-4ff3-9351-756b0298dfd1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046663 Aug 01 15:23:35.613572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 494/959] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:23:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:36.948721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1217647331", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd5fc8a7-9a70-4b95-a2b2-41f8b1f20c21"}], "security_groups": [{"name": "tempest-securitygroup--53187257"}], "key_name": "tempest-keypair-1314252279", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:37.054434 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] validate_networks() for [('dd5fc8a7-9a70-4b95-a2b2-41f8b1f20c21', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:23:37.445034 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:23:37.445460 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:23:37.445935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:23:37.446345 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:23:37.446838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:23:37.457215 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:37.457665 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:37.458495 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:37.458980 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:37.477749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:37.482737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Getting quotas for user f33ea26c1f72445bb4cb50ea503600dc and project 18f123f171554a58a2dea8fcc2afbefd. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:37.494879 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:23:37.497259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:23:37.548880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-856a577b-b44d-4c74-ae41-83f3033f7e54 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604634 Aug 01 15:23:37.555962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 466/960] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:23:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:23:37.572747 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ce0b42b9-c4d6-4741-b878-5dbcfca04387 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:37.575009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ce0b42b9-c4d6-4741-b878-5dbcfca04387 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:37.661942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ce0b42b9-c4d6-4741-b878-5dbcfca04387 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:37.669997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ce0b42b9-c4d6-4741-b878-5dbcfca04387 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1242 microversion: 2.1 time: 0.112330 Aug 01 15:23:37.670821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 495/961] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:37 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:38.692646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:38.693508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:38.711219 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:38.711931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:38.712929 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:38.713524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:38.810217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:38.820864 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5ad8f8dc-7647-4cd5-8c57-772263120e06 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1302 microversion: 2.1 time: 0.132792 Aug 01 15:23:38.822440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 467/962] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:38 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:39.843761 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:39.844645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:39.853506 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:39.854226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:39.855205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:39.855641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:40.338157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:40.347665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d17e7413-aca3-4b82-8f88-50e1482f939e tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.507668 Aug 01 15:23:40.349326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 496/963] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:39 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:40.575852 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-b49d103b-b93a-457b-8332-a49868d91267 req-5e39cbcb-e015-4c7f-945c-6fce75dff7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5aabbd-b880-4a6a-b291-445f618e7fa6", "tag": "600628f5-2de3-4cb9-aa84-229c4faa76a4"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:40.586862 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b49d103b-b93a-457b-8332-a49868d91267 req-5e39cbcb-e015-4c7f-945c-6fce75dff7f2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:40.587771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b49d103b-b93a-457b-8332-a49868d91267 req-5e39cbcb-e015-4c7f-945c-6fce75dff7f2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:40.600455 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-b49d103b-b93a-457b-8332-a49868d91267 req-5e39cbcb-e015-4c7f-945c-6fce75dff7f2 service nova] Creating event network-changed:600628f5-2de3-4cb9-aa84-229c4faa76a4 for instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 on hv-cinder-84327 Aug 01 15:23:40.605705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-b49d103b-b93a-457b-8332-a49868d91267 req-5e39cbcb-e015-4c7f-945c-6fce75dff7f2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 Aug 01 15:23:40.606501 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 468/964] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:41.372172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:41.373197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:41.380050 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:41.380504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:41.382308 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:41.382927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:41.645023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:41.653203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-024f5e22-7bf8-46b6-9615-b38f24a14556 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.285263 Aug 01 15:23:41.653768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 497/965] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:41 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:42.674539 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:42.675216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:42.681807 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:42.682407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:42.683411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:42.684037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:42.822508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:42.835967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a849be33-397a-4404-96e9-3851f98997c3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.166252 Aug 01 15:23:42.836662 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 469/966] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:42 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:43.857228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:43.857815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:43.864387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:43.865456 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:43.866388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:43.866855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:44.150395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:44.157792 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0acae234-65ea-4051-a6eb-cf4c7b93da5c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.304861 Aug 01 15:23:44.158363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 498/967] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:43 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:45.179011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:45.179559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:45.186264 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:45.186850 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:45.187615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:45.188056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:45.317624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:45.327393 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8d10cd2e-5a0b-41a0-ad66-feafe2bbd330 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.152504 Aug 01 15:23:45.327951 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 470/968] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:45 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:46.344399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-04b4d77b-7502-4862-8d19-72485daf77ab req-a7085304-c0ae-4d47-957e-08458812b28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5aabbd-b880-4a6a-b291-445f618e7fa6", "name": "network-vif-plugged", "status": "completed", "tag": "600628f5-2de3-4cb9-aa84-229c4faa76a4"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:46.349007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:46.351122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:46.355720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.358261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-04b4d77b-7502-4862-8d19-72485daf77ab req-a7085304-c0ae-4d47-957e-08458812b28e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:46.358708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.358868 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-04b4d77b-7502-4862-8d19-72485daf77ab req-a7085304-c0ae-4d47-957e-08458812b28e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:46.360720 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:46.361435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:46.362459 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:46.363306 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:46.374213 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-04b4d77b-7502-4862-8d19-72485daf77ab req-a7085304-c0ae-4d47-957e-08458812b28e service nova] Creating event network-vif-plugged:600628f5-2de3-4cb9-aa84-229c4faa76a4 for instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 on hv-cinder-84327 Aug 01 15:23:46.379895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-04b4d77b-7502-4862-8d19-72485daf77ab req-a7085304-c0ae-4d47-957e-08458812b28e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039020 Aug 01 15:23:46.381048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 499/969] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:46.501195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:46.509178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ba9a11b8-7637-4d65-891e-4199f86fcaf8 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.164351 Aug 01 15:23:46.509793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 471/970] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:46 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:47.531173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:47.531860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:47.540055 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:47.540508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:47.541285 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:47.541721 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:47.669926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:47.672259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:47.678793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4a1ffc78-f788-4d64-8e67-2ce4eb4a824d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1366 microversion: 2.1 time: 0.151916 Aug 01 15:23:47.679355 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 500/971] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:47 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:48.699486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:48.700370 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:48.703066 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.703728 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:48.711272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:48.711716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:48.712478 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:48.713526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:48.846676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:48.854258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cf86ad9a-1261-4bc1-b96d-eef7079738ba tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1551 microversion: 2.1 time: 0.158714 Aug 01 15:23:48.854841 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 472/972] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:23:48 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:48.874283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:48.874848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:48.881753 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:48.882309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:48.883098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:48.883526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:48.961679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f7723d77-410b-4021-b9a9-feb1a9eb3bd3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091403 Aug 01 15:23:48.962267 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 501/973] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:23:48 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:50.117724 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-0c7c98de-02b4-412d-8606-40df9e464705 req-bcc545be-fd4f-4918-aa36-21c0b879f048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5aabbd-b880-4a6a-b291-445f618e7fa6", "tag": "600628f5-2de3-4cb9-aa84-229c4faa76a4"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:50.128099 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-0c7c98de-02b4-412d-8606-40df9e464705 req-bcc545be-fd4f-4918-aa36-21c0b879f048 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:50.128546 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-0c7c98de-02b4-412d-8606-40df9e464705 req-bcc545be-fd4f-4918-aa36-21c0b879f048 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:50.140289 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-0c7c98de-02b4-412d-8606-40df9e464705 req-bcc545be-fd4f-4918-aa36-21c0b879f048 service nova] Creating event network-changed:600628f5-2de3-4cb9-aa84-229c4faa76a4 for instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 on hv-cinder-84327 Aug 01 15:23:50.145263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-0c7c98de-02b4-412d-8606-40df9e464705 req-bcc545be-fd4f-4918-aa36-21c0b879f048 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031315 Aug 01 15:23:50.145907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 473/974] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:39.152725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=5 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.153462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=40 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.158190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.158728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.165593 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.166042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.166824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.167257 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.190448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a45d6544-884b-4c4d-8db0-0a886a178916 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/ips" status: 200 len: 151 microversion: 2.20 time: 0.039309 Aug 01 15:24:39.191035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 502/975] 10.222.0.100 () {60 vars in 1294 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:46.045517 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=5 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.046265 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.051536 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-706238596", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-505595786", "security_groups": [{"name": "tempest-secgroup-smoke-1511582412"}], "block_device_mapping_v2": [{"uuid": "36e4fb4c-a88d-4211-9c35-0980ec990680", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b745091-6599-407e-ab8f-a04aefc65659"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:46.343221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] validate_networks() for [('7b745091-6599-407e-ab8f-a04aefc65659', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:46.729587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:46.730013 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:46.730494 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:46.730937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:46.731353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:46.741314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.741758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.742584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.743052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.760175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for project f44ad042ba9b4bdc91783fce54774c29. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:46.766914 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Getting quotas for user c6795a827b8d411aaa165db7b38435ce and project f44ad042ba9b4bdc91783fce54774c29. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:46.830956 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:46.833178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36e4fb4c-a88d-4211-9c35-0980ec990680',volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:46.965194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-012d9346-8e0c-410c-b070-2074e04b4bba tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.921471 Aug 01 15:24:46.965829 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 474/976] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:24:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 01 15:24:46.976901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-562ab8c8-baad-4923-9fed-bbafa70022fe tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:46.977494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-562ab8c8-baad-4923-9fed-bbafa70022fe tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:47.141944 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-562ab8c8-baad-4923-9fed-bbafa70022fe tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.149600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-562ab8c8-baad-4923-9fed-bbafa70022fe tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1096 microversion: 2.1 time: 0.176665 Aug 01 15:24:47.150145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 503/977] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:46 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1096 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:47.350776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:47.351326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:47.360051 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.360515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.361301 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.361743 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.391113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lazy-loading 'flavor' on Instance uuid 0f5bea0c-113f-48b4-a58b-6add2d371ea4 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:24:47.596058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ac897c38-2d8f-40d2-88c9-31999382da29 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/action" status: 202 len: 0 microversion: 2.20 time: 0.249792 Aug 01 15:24:47.596693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 475/978] 10.222.0.100 () {62 vars in 1324 bytes} [Mon Aug 1 15:24:47 2022] POST /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:24:47.604885 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:47.605523 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:47.612914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.613363 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.614142 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.614578 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.751325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.760190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.761732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.762931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-99a27365-9926-433d-af4e-237d120e9bc5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.161922 Aug 01 15:24:47.764137 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 504/979] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:47 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:48.171987 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:48.172994 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:48.179842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.180276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.181042 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.181461 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.254212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:48.263755 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-04edc21c-5840-4c57-b5fa-fc7c97369470 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1194 microversion: 2.1 time: 0.096323 Aug 01 15:24:48.264723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 476/980] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:48 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:48.954146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:48.955432 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:48.962396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.963492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.965156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.966073 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.159597 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.168778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.170466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.171889 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-99867c48-b9b8-4d1b-bf19-bf721ba4da21 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.388533 Aug 01 15:24:49.172986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 505/981] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:48 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:49.288062 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:49.288672 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:49.295994 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:49.296433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.297198 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:49.297630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.435840 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.443615 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de083b95-8bb2-4e43-b030-6aa6fe418b17 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.159442 Aug 01 15:24:49.444384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 477/982] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:49 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:49.739911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-8fc833c7-7714-4ce1-9d0b-0b7780200ac1 req-9a99b196-461f-4a1b-a741-9a0d28c73e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9", "tag": "765f0237-ede4-463a-95f5-ddf4142626e1"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:49.751621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-8fc833c7-7714-4ce1-9d0b-0b7780200ac1 req-9a99b196-461f-4a1b-a741-9a0d28c73e71 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:49.752070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-8fc833c7-7714-4ce1-9d0b-0b7780200ac1 req-9a99b196-461f-4a1b-a741-9a0d28c73e71 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.764975 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-8fc833c7-7714-4ce1-9d0b-0b7780200ac1 req-9a99b196-461f-4a1b-a741-9a0d28c73e71 service nova] Creating event network-changed:765f0237-ede4-463a-95f5-ddf4142626e1 for instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 on hv-cinder-84327 Aug 01 15:24:49.770272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-8fc833c7-7714-4ce1-9d0b-0b7780200ac1 req-9a99b196-461f-4a1b-a741-9a0d28c73e71 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034611 Aug 01 15:24:49.771360 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 506/983] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:50.199543 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:50.200429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:50.206714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.207299 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.208081 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.208521 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.344763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.352792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.354304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.355489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f52ccd3-460e-4e92-aaf9-024d45c6813d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.160840 Aug 01 15:24:50.356053 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 478/984] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:50 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:50.466145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:50.466965 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:50.473273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.473720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.474508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.474966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.618181 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.625784 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-67677207-a401-48e5-85a1-e908ca5c6769 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.164330 Aug 01 15:24:50.626328 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 507/985] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:50 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:51.378963 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:51.379555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:51.386288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.386777 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.387550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.387991 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.530538 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:51.539401 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:51.541064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:51.542501 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ff9aabb7-656a-4f6d-b91e-b4b607e625af tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.167545 Aug 01 15:24:51.543170 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 479/986] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:51 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:51.646475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:51.647244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:51.653995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.654436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.655219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.655651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.794166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:51.807793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-cb8dca37-c9fc-47d3-8950-0fcc60e48efb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.164813 Aug 01 15:24:51.808806 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 508/987] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:51 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:52.565301 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:52.565925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:52.572437 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.572881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.573630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.574057 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.711267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:52.719729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:52.721202 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:52.722343 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-27899026-ede0-4b97-97ac-d6704b567801 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.160964 Aug 01 15:24:52.722935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 480/988] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:52 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:52.835998 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:52.836554 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:52.843219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.843665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.844454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.844888 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.986602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:52.994103 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f5de790f-b309-4879-af77-501e6753b417 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.162117 Aug 01 15:24:52.994740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 509/989] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:52 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:53.746924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:53.748098 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:53.754566 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.755052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.755825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.756249 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.890231 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:53.898234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:53.899784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:53.900940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f0330bc-4cad-4cc2-b3b2-31aecfa9a719 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.158445 Aug 01 15:24:53.901493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 481/990] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:53 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:54.015622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:54.016235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:54.022436 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.022926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.023692 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.024129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.159136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:54.166934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-89480f1e-41c9-4e42-9479-2fa98772d905 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.155340 Aug 01 15:24:54.167495 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 510/991] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:54 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:54.927258 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:54.927860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:54.934471 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.935612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.936367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.936795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:55.068848 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:55.076906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:55.078432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:55.079690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ccd56651-42c3-4b3a-a328-0d9fc62f9652 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.157076 Aug 01 15:24:55.080244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 482/992] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:54 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:55.188602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:55.189188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:55.195774 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:55.196244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:55.196996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:55.197425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:55.335082 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:55.343007 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d3dcd1d7-d5a2-4bba-8d20-57a3b13552ee tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.158385 Aug 01 15:24:55.343558 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 511/993] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:55 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:56.103090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:56.103764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:56.110272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:56.110744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.111508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:56.111935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.252428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:56.261529 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:56.263489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:56.265021 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc3f0417-3a30-43a5-aa33-06c6f5b1e968 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.165811 Aug 01 15:24:56.265711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 483/994] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:56 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:56.363922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:56.364533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:56.371091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:56.371532 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.372952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:56.373397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.512386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:56.519933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c6817863-bca8-479d-97c7-432fe965c060 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.159908 Aug 01 15:24:56.520496 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 512/995] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:56 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:57.293603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:57.294951 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:57.296903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.297565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.304031 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.304474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.305230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.305664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.449537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:57.457976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:57.459520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:57.460693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c8074fb-3277-490b-9c04-3588f6135b9d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.171452 Aug 01 15:24:57.461252 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 484/996] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:57 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:57.542445 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:57.543148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:57.545841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.552015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.552462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.553233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.553662 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.688650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:57.696250 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-29ea4726-7b2b-43e0-ad6d-8adc0eddc95a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.158622 Aug 01 15:24:57.696794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 513/997] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:57 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:58.484771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:58.485451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:58.492605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:58.493146 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:58.493976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:58.494475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:58.634980 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:58.643719 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:58.645393 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:58.646606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa7e5260-1aa7-4f98-8442-9c602ece7cb8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.166396 Aug 01 15:24:58.647195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 485/998] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:58 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:58.718445 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:58.719091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:58.726114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:58.726569 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:58.727399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:58.727833 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:58.866416 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:58.874572 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-19a36ee9-789c-4496-8591-e568de240f68 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.160569 Aug 01 15:24:58.875206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 514/999] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:58 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:59.671966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:59.672596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:59.679794 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:59.680242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:59.681035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:59.681474 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:59.811089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:59.819091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:59.820585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:59.821728 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-47bca381-1078-4525-a0a8-2d004b2c1903 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.154453 Aug 01 15:24:59.822277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 486/1000] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:24:59 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:59.895695 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:59.896280 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:59.902854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:59.903302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:59.904576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:59.905010 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:00.046299 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:00.054083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b43dbd21-f1f1-4120-9e77-c7cca694a9ca tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.162255 Aug 01 15:25:00.054640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 515/1001] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:24:59 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:00.844084 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:00.844745 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:00.851132 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:00.851573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:00.852323 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:00.852747 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:00.988874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:00.996878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:00.999044 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:01.000187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-60e594c3-9566-4be3-a047-c1153e86a9c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1746 microversion: 2.20 time: 0.160085 Aug 01 15:25:01.000744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 487/1002] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:00 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:01.075470 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:01.076109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:01.082633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:01.083131 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:01.083899 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:01.084333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:01.219293 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:01.227013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dde2a090-b5a5-4c90-9349-c4a8c31f5919 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.155921 Aug 01 15:25:01.227560 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 516/1003] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:01 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:01.927596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-c4c82edf-8f90-474d-b6e6-31b8c95aaac9 req-f0f4a773-dd62-4bd9-aac1-a99d0446de80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9", "name": "network-vif-plugged", "status": "completed", "tag": "765f0237-ede4-463a-95f5-ddf4142626e1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:01.941734 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c4c82edf-8f90-474d-b6e6-31b8c95aaac9 req-f0f4a773-dd62-4bd9-aac1-a99d0446de80 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:01.942462 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c4c82edf-8f90-474d-b6e6-31b8c95aaac9 req-f0f4a773-dd62-4bd9-aac1-a99d0446de80 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:01.957245 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-c4c82edf-8f90-474d-b6e6-31b8c95aaac9 req-f0f4a773-dd62-4bd9-aac1-a99d0446de80 service nova] Creating event network-vif-plugged:765f0237-ede4-463a-95f5-ddf4142626e1 for instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 on hv-cinder-84327 Aug 01 15:25:01.962362 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-c4c82edf-8f90-474d-b6e6-31b8c95aaac9 req-f0f4a773-dd62-4bd9-aac1-a99d0446de80 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039019 Aug 01 15:25:01.963247 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 488/1004] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:02.024664 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:02.025266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:02.031451 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:02.031899 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:02.032664 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:02.033098 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:02.176832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:02.188146 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:02.189769 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:02.191078 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ada14fd4-3c84-4bd0-a219-ad79c140c2c3 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1746 microversion: 2.20 time: 0.170317 Aug 01 15:25:02.191865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 517/1005] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:02 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:02.248935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:02.249627 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:02.256008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:02.256449 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:02.257209 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:02.257639 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:02.395239 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:02.398802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:02.403595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7652bac4-a167-4dfa-b7fb-b78709233dc4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.159480 Aug 01 15:25:02.404164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 489/1006] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:02 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:03.215063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:03.215745 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:03.222929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.223380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:03.224154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.224586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:03.355291 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:03.363503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:03.365025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:03.366243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-44ca310a-ba45-4e5d-b9ff-afcc26fa04f8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1746 microversion: 2.20 time: 0.155047 Aug 01 15:25:03.366800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 518/1007] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:03 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:03.424525 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:03.425130 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:03.432309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.432753 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:03.433511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.433944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:03.571638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:03.580059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94c37efd-1d6f-4878-a60c-802432330dec tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.160180 Aug 01 15:25:03.580961 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 490/1008] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:03 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:03.984707 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-5b353607-ca3c-4b5a-90b6-21fa17530392 req-5c6276fa-7f3d-4c78-b672-c231b4fdaa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "name": "network-vif-plugged", "status": "completed", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:03.994113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5b353607-ca3c-4b5a-90b6-21fa17530392 req-5c6276fa-7f3d-4c78-b672-c231b4fdaa35 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.994563 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-5b353607-ca3c-4b5a-90b6-21fa17530392 req-5c6276fa-7f3d-4c78-b672-c231b4fdaa35 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.007995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-5b353607-ca3c-4b5a-90b6-21fa17530392 req-5c6276fa-7f3d-4c78-b672-c231b4fdaa35 service nova] Creating event network-vif-plugged:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:25:04.013056 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-5b353607-ca3c-4b5a-90b6-21fa17530392 req-5c6276fa-7f3d-4c78-b672-c231b4fdaa35 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032587 Aug 01 15:25:04.013636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 519/1009] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:04.389645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:04.390190 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:04.396215 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:04.396662 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.397414 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:04.397845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.532227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:04.540356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:04.541867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:04.543089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-678dbec5-bfee-43e1-b6d5-197c454f4626 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1746 microversion: 2.20 time: 0.157464 Aug 01 15:25:04.543838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 491/1010] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:04 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:04.602797 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:04.603504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:04.609787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:04.610238 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.611034 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:04.611475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.755651 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:04.764148 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3624675a-2817-4be8-b8a3-a6acf88f4515 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1268 microversion: 2.1 time: 0.166131 Aug 01 15:25:04.764724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 520/1011] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:04 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:05.566431 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:05.567223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:05.573370 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.573820 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.574585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.575070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.706837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:05.714843 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:05.716866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:05.718043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-920ca2c0-3f96-4200-9c95-55a0910a9c97 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1746 microversion: 2.20 time: 0.155932 Aug 01 15:25:05.718588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 492/1012] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:05 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:05.785629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:05.786324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:05.792749 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.793202 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.794594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.795068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.799562 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=100 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:05.926607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:05.934274 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-75346248-0efd-4158-a8f1-8d9b815685b7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1455 microversion: 2.1 time: 0.152514 Aug 01 15:25:05.934981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 521/1013] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:05 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:05.955465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:05.956073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:05.962044 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.962489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.963291 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.963722 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:06.095129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:06.103384 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-06cc38f6-a3d4-4553-83bb-7b349902deab tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1455 microversion: 2.1 time: 0.151806 Aug 01 15:25:06.104223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 493/1014] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:05 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:06.742065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:06.742970 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:06.749951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:06.750406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:06.751228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:06.751673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:06.999241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:07.007261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:07.008779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:07.009964 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-406f92a5-00e6-4f6e-8069-593120ed6e0d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1746 microversion: 2.20 time: 0.272112 Aug 01 15:25:07.010517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 522/1015] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:06 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1746 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:08.015736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-16ef4455-9e8d-4402-ab9c-4e514243f923 req-890ffd62-417b-4860-8b3b-d061e45ee41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9", "tag": "765f0237-ede4-463a-95f5-ddf4142626e1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:08.026391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-16ef4455-9e8d-4402-ab9c-4e514243f923 req-890ffd62-417b-4860-8b3b-d061e45ee41c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:08.026873 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-16ef4455-9e8d-4402-ab9c-4e514243f923 req-890ffd62-417b-4860-8b3b-d061e45ee41c service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:08.034094 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:08.035598 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:08.047483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:08.048943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:08.050180 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:08.051414 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:08.071326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-16ef4455-9e8d-4402-ab9c-4e514243f923 req-890ffd62-417b-4860-8b3b-d061e45ee41c service nova] Creating event network-changed:765f0237-ede4-463a-95f5-ddf4142626e1 for instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 on hv-cinder-84327 Aug 01 15:25:08.081376 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-16ef4455-9e8d-4402-ab9c-4e514243f923 req-890ffd62-417b-4860-8b3b-d061e45ee41c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069596 Aug 01 15:25:08.083522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 494/1016] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:08.227776 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:08.236669 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:08.238588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:08.239815 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-666b6cfb-0fd4-45b1-9c8d-0f4579759f1e tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.209602 Aug 01 15:25:08.241649 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 523/1017] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:08 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:09.265418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:09.266383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:09.284650 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:09.285566 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:09.286698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:09.287696 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:09.521766 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:09.532774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:09.534986 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:09.536591 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-91689351-0367-47a1-b70f-7ac730386563 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.276338 Aug 01 15:25:09.554751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 495/1018] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:09 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:10.561719 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:10.562324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:10.565079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=47 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:10.571483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:10.571933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:10.572703 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:10.573136 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:10.731009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:10.741545 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:10.743075 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:10.744355 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a69ed05a-d8e8-462a-a12c-dafb272a4a2b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.186502 Aug 01 15:25:10.744900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 524/1019] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:10 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:11.772626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:11.773960 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:11.786738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:11.787217 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:11.788031 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:11.788468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:11.997745 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:12.004863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:12.006608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:12.007948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3ffb4b51-7671-44be-a4de-545d3810d90c tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.242827 Aug 01 15:25:12.008511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 496/1020] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:11 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:13.036122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:13.036935 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:13.049515 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:13.051015 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:13.052687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:13.053673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:13.263614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:13.275162 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:13.277549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:13.279145 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f5b66642-de6d-4abb-b256-090dccf70cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.247822 Aug 01 15:25:13.293440 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 525/1021] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:13 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:14.306483 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:14.307330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:14.314609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.315085 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.315866 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.316565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.489207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:14.499092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:14.501263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:14.502485 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e8b5913a-0896-479e-be60-231eac3d75c5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.201456 Aug 01 15:25:14.503212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 497/1022] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:14 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:14.575041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:14.576197 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:14.589118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.589855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.591665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.592354 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.619529 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8ea9ab82-a6fa-442a-b79b-53e9df83b15a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/ips" status: 200 len: 149 microversion: 2.1 time: 0.051153 Aug 01 15:25:14.620096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 526/1023] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:25:14 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:15.530646 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:15.531262 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:15.538894 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.539808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.540853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.541508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.740734 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:15.754350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:15.757257 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:15.760018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ab384c85-8dca-46ce-964b-0978c39d817f tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.234161 Aug 01 15:25:15.760825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 498/1024] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:15 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:16.228926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:16.234821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:16.245028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.246154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.247571 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.248057 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.640540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a154422f-29a7-47b3-9235-1c99baf066b9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419075 Aug 01 15:25:16.641622 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 527/1025] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:25:16 2022] POST /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:16.803075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:16.812551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:16.832618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:16.836710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.837594 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.839026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.839913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.069373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:17.078356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:17.079924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:17.081276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb097440-9317-4918-a50f-c6a86ed0638a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.287680 Aug 01 15:25:17.083898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 499/1026] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:16 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:18.123849 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:18.124962 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:18.135292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.136019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.137284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.137947 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.297994 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:18.306813 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:18.308315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:18.309761 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f7fc918a-5884-4e84-8887-d472288590be tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.194916 Aug 01 15:25:18.310716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 528/1027] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:18 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:19.336711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:19.337315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:19.344623 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:19.345068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:19.345831 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:19.346313 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:19.482398 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:19.490475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:19.492153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:19.493327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1661830a-91b8-4708-8331-38935ff3db43 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1741 microversion: 2.20 time: 0.160556 Aug 01 15:25:19.493880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 500/1028] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:19 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:20.517028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:20.517652 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:20.524233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.524673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.525430 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.525880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.659902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:20.670024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:20.671969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:20.673163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3db1b60d-0773-40b5-a622-19aaa0c1e712 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1723 microversion: 2.20 time: 0.160660 Aug 01 15:25:20.673713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 529/1029] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:20 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:21.698159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:21.698826 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:21.706393 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.706887 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.707660 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.708105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.842260 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:21.850210 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:21.851748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:21.852910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0ab3c56b-7fd5-48a0-b887-3a5d1f8aff17 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1723 microversion: 2.20 time: 0.158911 Aug 01 15:25:21.853489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 501/1030] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:21 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:22.876414 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:22.877068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:22.883823 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.884275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:22.885046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.885486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:23.020326 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:23.029814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:23.031365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:23.032552 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-82a4c4e4-9846-4853-9181-c1f6cd1d2ed8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1723 microversion: 2.20 time: 0.160088 Aug 01 15:25:23.034599 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 530/1031] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:22 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:23.764893 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6996c514-c527-4784-af41-592bfd3405a7 req-d8f39918-0e42-44f2-9c7c-a5de9aa36896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:23.775175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6996c514-c527-4784-af41-592bfd3405a7 req-d8f39918-0e42-44f2-9c7c-a5de9aa36896 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:23.775626 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6996c514-c527-4784-af41-592bfd3405a7 req-d8f39918-0e42-44f2-9c7c-a5de9aa36896 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:23.791447 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6996c514-c527-4784-af41-592bfd3405a7 req-d8f39918-0e42-44f2-9c7c-a5de9aa36896 service nova] Creating event network-vif-unplugged:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:25:23.799155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6996c514-c527-4784-af41-592bfd3405a7 req-d8f39918-0e42-44f2-9c7c-a5de9aa36896 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037350 Aug 01 15:25:23.800359 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 502/1032] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:24.057009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:24.057589 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:24.065199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.066134 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.067150 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.067739 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.229106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:24.238057 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:24.239865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:24.240951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-06c4330a-568b-461b-8490-a3741dfc2e32 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1726 microversion: 2.20 time: 0.188077 Aug 01 15:25:24.241665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 531/1033] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:24 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:24.264840 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f84706d-b7e3-4051-9df5-b0423584995c"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:24.267315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:24.273855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.274343 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.275091 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.275519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.304388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f9f5b60a-473d-4e1f-9c80-3cb4b244906b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: .version_select at 0x7efd219f41f0>, body: {"keypair": {"name": "tempest-keypair-1845186826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/1kF2yEAz2aipndH0gu39qQfdcmq3q6hIaB4BOz9O4qp11C2UlQuhFFrTTIqLLvJHorYB/StFd9zCHIf36co+vu4XC2VyNzKU8ivL0ORPDDB26E3pfHVE425jJ/kLpvA=="}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:24.321321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-f9f5b60a-473d-4e1f-9c80-3cb4b244906b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:24.326914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-f9f5b60a-473d-4e1f-9c80-3cb4b244906b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:24.360340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f9f5b60a-473d-4e1f-9c80-3cb4b244906b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059940 Aug 01 15:25:24.362699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 532/1034] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:24.681975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9b78c2cd-7769-4942-b4d4-4ed98469c40b tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.421905 Aug 01 15:25:24.682574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 503/1035] 10.222.0.100 () {62 vars in 1369 bytes} [Mon Aug 1 15:25:24 2022] POST /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-volume_attachments => generated 188 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:24.868054 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:24.868830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:24.876893 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.877503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.878543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.879313 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.182333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e98a83da-6abb-42ba-9db5-d3e037375bab tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-volume_attachments/5f84706d-b7e3-4051-9df5-b0423584995c" status: 202 len: 0 microversion: 2.20 time: 0.318738 Aug 01 15:25:25.186182 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 533/1036] 10.222.0.100 () {60 vars in 1462 bytes} [Mon Aug 1 15:25:24 2022] DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-volume_attachments/5f84706d-b7e3-4051-9df5-b0423584995c => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:25.254577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:25.255538 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.261938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.262386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.263191 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.263628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.312496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117886) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:25:25.356821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:25.398993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9bc98df-a766-4910-86b1-e6e3765d88fd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "POST /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/action" status: 202 len: 0 microversion: 2.20 time: 0.149301 Aug 01 15:25:25.404441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 504/1037] 10.222.0.100 () {62 vars in 1324 bytes} [Mon Aug 1 15:25:25 2022] POST /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:25.408877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:25.409471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.422358 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.422846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.424070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.424699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.893829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:25.909277 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:25.910977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:25.912330 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fc1d3a55-71d5-4e6f-99d4-035196672ef2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1674 microversion: 2.20 time: 0.507458 Aug 01 15:25:25.913327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 534/1038] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:25 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1674 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:26.023185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1080621189", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64714ec3-4fee-42c0-bc82-5b770c41babf"}], "security_groups": [{"name": "tempest-securitygroup--1377548888"}], "key_name": "tempest-keypair-1845186826", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:26.164984 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] validate_networks() for [('64714ec3-4fee-42c0-bc82-5b770c41babf', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:25:26.572714 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:25:26.573357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:25:26.573582 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:25:26.573983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:25:26.574386 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:25:26.584194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.584804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.585601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.586033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.602720 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:26.606932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:26.617712 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:25:26.620009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:25:26.667405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9c3cf287-52c0-492b-921c-5420d4fd3315 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.648582 Aug 01 15:25:26.668396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 505/1039] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:25:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:25:26.683284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-65f8769c-4f15-4f4c-a354-e1761f8b7c6a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.683900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-65f8769c-4f15-4f4c-a354-e1761f8b7c6a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.766111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-65f8769c-4f15-4f4c-a354-e1761f8b7c6a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:26.773122 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-65f8769c-4f15-4f4c-a354-e1761f8b7c6a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1246 microversion: 2.1 time: 0.093860 Aug 01 15:25:26.774011 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 535/1040] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:26.959225 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.960137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.968854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.969624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.971036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.971804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.147870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:27.158997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:27.160792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:27.161982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-29c557cf-ac9f-4066-8129-cfedab4be7a5 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.210941 Aug 01 15:25:27.162878 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 506/1041] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:27.799158 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:27.799855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:27.807075 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.807517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.808273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.808701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.824504 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:27.874873 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:27.884912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f7a6a2d9-5d82-463b-918a-52fd0a52b211 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1298 microversion: 2.1 time: 0.089496 Aug 01 15:25:27.885547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 536/1042] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:27 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:28.192379 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:28.193839 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:28.212347 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.213110 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.214275 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.214997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.431792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.441133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.443024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.444473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-975ef6af-7322-4c02-8005-18150c432ade tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.257582 Aug 01 15:25:28.445508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 507/1043] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:28 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:28.907102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:28.908388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:28.915797 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.916500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.917454 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.918044 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.983615 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.991679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7564ef73-c096-4fdc-a72e-09ca02f1afe6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.088691 Aug 01 15:25:28.992238 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 537/1044] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:28 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:29.477433 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:29.479120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:29.487782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.488788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.489948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.490645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.639688 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.651711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.654469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.655726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-92545b7e-0ee6-4795-9587-f3cda1a016f9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.182708 Aug 01 15:25:29.661562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 508/1045] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:29 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:30.015426 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.016079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.023562 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.024004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.024781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.025210 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.106819 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:30.116189 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9a8cddab-78d3-4eb7-82d0-c10f1648227c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.104571 Aug 01 15:25:30.116886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 538/1046] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:30 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:30.679293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.679963 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.686642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.687112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.687870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.688297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.839263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:30.848662 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:30.850143 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:30.851321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4863799c-33f7-4194-af3f-31365593922a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.176030 Aug 01 15:25:30.851876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 509/1047] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:30 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:31.139521 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:31.141025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:31.149041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.149878 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:31.151081 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.151732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:31.221596 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:31.229595 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bebc1e51-a7a1-4de1-8392-43fd64b19316 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.094628 Aug 01 15:25:31.230177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 539/1048] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:31 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:31.877726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:31.878810 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:31.889171 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.889890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:31.891153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.891855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.059554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.067642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.069117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.070295 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4c795a57-6ab4-48ac-ae7d-4c86478d81ea tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.199867 Aug 01 15:25:32.071006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 510/1049] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:31 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:32.255347 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:32.256988 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:32.265880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.266710 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.267641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.268245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.338125 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.348445 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d487ac1c-7a66-4080-abb2-6529d49ab6c6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.100830 Aug 01 15:25:32.350196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 540/1050] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:32 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:32.430598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:32.431111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:32.437112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.437559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.438309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.438764 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.463577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-08750ec5-9f64-4969-a73f-a7707bdcd7aa tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/ips" status: 200 len: 145 microversion: 2.1 time: 0.209149 Aug 01 15:25:32.464141 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 511/1051] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:25:32 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/ips => generated 145 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:33.099632 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.100243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.106255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.106734 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.107501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.107939 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.274147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:33.294678 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:33.297517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:33.299693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0307db4a-d0ec-431f-a63a-c6761f3f616d tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.203716 Aug 01 15:25:33.300650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 541/1052] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:33.385846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.386440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.393484 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.393932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.394752 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.395441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.484351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:33.492129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-53083353-42d3-437a-89ef-58b448a368d4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.110204 Aug 01 15:25:33.492704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 512/1053] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:34.326106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:34.327009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.337156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.337744 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.338941 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.339580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.491588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:34.500686 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:34.502092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:34.503475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0dbb6656-6eae-4fac-8eff-2787bb51d7e1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.183002 Aug 01 15:25:34.504285 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 542/1054] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:34 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:34.513618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:34.515088 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.524034 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.524940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.526475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.527932 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.623197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:34.632242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5177cdf6-cfb7-4eca-b1ae-4144ec8e038e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.122463 Aug 01 15:25:34.632972 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 513/1055] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:34 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:34.912233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d369282-c8e1-4d70-8848-d0216e498cde"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:34.914693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.921477 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.921929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.922731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.923178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.556683 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.557724 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.569898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.571075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.572490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.573315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.751661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:35.760000 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:35.761508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:35.763264 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-60944bc9-dba9-49f0-8c86-b586b2d92526 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.217612 Aug 01 15:25:35.763833 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 514/1056] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:35 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:35.768285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.768888 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.775173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.775562 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.776322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.776795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.841308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:35.849033 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5cfd32d0-be23-4e8f-8479-7c9da299f356 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.084240 Aug 01 15:25:35.849957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 515/1057] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:35 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:36.770559 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.787584 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:36.788214 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:36.790513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.791342 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:36.796924 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.797415 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.798122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.798557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.941681 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:36.950710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:36.952289 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:36.953874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bc2d24b7-02c8-4f4b-84e1-b607231fe6e0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.170163 Aug 01 15:25:36.954590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 516/1058] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:36 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:36.960172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:36.961140 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:36.973720 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.974254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.975239 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.975744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:37.068239 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:37.076803 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ab46db11-2fd6-470d-bcd1-7b7f06b824ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.120998 Aug 01 15:25:37.077363 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 517/1059] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:36 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:37.995153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:37.995872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:38.003979 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:38.004389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.005173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:38.005603 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.194063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:38.209011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:38.211154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:38.212867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-48df82f8-658f-4565-a5fc-326d370ec250 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.224605 Aug 01 15:25:38.213513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 518/1060] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:37 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:38.218410 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:38.219231 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:38.226443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:38.227138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.228269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:38.228876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.325212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:38.337716 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc5c5331-4bfa-41eb-88ee-ab4ece5373ec tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.122825 Aug 01 15:25:38.338690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 519/1061] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:38 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:39.243817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:39.244939 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:39.255936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.256699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.257962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.258889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.399436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:39.408737 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:39.410423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:39.411704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-547c3ec6-103d-4e79-8647-ca935e268487 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.177358 Aug 01 15:25:39.412352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 520/1062] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:39 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:39.422373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:39.423315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:39.430479 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.431105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.431895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.432357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.498815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:39.502305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.507550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4421e888-60e1-42ed-8dd2-aa22d568fdd7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.089689 Aug 01 15:25:39.508124 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 521/1063] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:39 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:40.436531 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:40.437282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:40.445564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.446074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.446873 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.447309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.600196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:40.608335 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:40.609913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:40.611197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2db4c094-ca57-456d-93d3-0c236cbd9a84 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.178751 Aug 01 15:25:40.611841 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 522/1064] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:40 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:40.618739 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:40.618739 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:40.627952 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.628405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.629206 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.629647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.695838 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:40.704131 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7994aa93-d002-4f1b-a069-198f1f5cf8b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.091306 Aug 01 15:25:40.704700 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 523/1065] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:40 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:41.638758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.639430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:41.646092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:41.646548 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:41.647366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:41.647806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:41.795526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:41.803877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:41.805317 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:41.806476 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0c8d42e5-151d-4e31-8419-7afd6195f36a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.172416 Aug 01 15:25:41.807062 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 524/1066] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:41.812122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.812725 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:41.818592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:41.819143 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:41.819907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:41.820338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:41.882122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:41.890266 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bb4c2682-13bc-40b9-a5b8-3891c9ffd338 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.082253 Aug 01 15:25:41.890856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 525/1067] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:42.830699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:42.831385 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:42.837749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.838315 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.839178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.839711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.978304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:42.987107 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:42.988612 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:42.989775 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ff46d50c-2d5c-4af3-8a39-2beda8c3abf7 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.163707 Aug 01 15:25:42.990331 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 526/1068] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:42 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:42.994739 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:42.995344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:43.001950 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.002391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.003179 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.003718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.065467 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:43.074570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6aebc9a3-a6f6-4a2f-914b-bea2b6976590 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.083258 Aug 01 15:25:43.075172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 527/1069] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:42 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:44.014116 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:44.014853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:44.021469 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.021900 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.022676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.023128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.162967 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:44.171450 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:44.172949 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:44.174112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6d6cc699-6056-414a-85c6-04c4b8ab8851 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.164566 Aug 01 15:25:44.174680 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 528/1070] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:44 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:44.179119 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:44.179726 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:44.185738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.186272 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.187136 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.187574 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.252282 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:44.260046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5d3e2071-2f6e-4a49-9cfc-81eeb2612df8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.084361 Aug 01 15:25:44.260693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 529/1071] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:44 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:44.918814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.007240 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=45 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.197322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:45.197929 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:45.204666 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:45.205111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.205875 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:45.206303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.414095 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:45.422906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:45.424412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:45.425585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-32a22db0-28f6-4a6f-ac75-f9dc12dc7108 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.232279 Aug 01 15:25:45.426169 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 530/1072] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:45 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:45.430590 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:45.431229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:45.439184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:45.439647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.440421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:45.440971 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.506174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:45.514112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-292ec91e-0b37-4f41-92af-ca52eef0eb2a tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.087031 Aug 01 15:25:45.514912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 531/1073] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:45 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:46.454685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:46.455278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:46.465999 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.466456 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.467359 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.467801 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.603329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:46.611512 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:46.613024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:46.614185 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b900f2be-3ad0-4f1b-a01a-8c31f35cc7de tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.164074 Aug 01 15:25:46.614771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 532/1074] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:46 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:46.619119 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:46.619727 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:46.625544 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.625991 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.626776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.627215 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.689032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:46.698124 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cdeaf760-a59f-46bb-89ce-765b9694b6b5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.082326 Aug 01 15:25:46.698944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 533/1075] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:46 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:47.638762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.639445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:47.641892 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:47.647402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.647855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.648621 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.649069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.782630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:47.790732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:47.792212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:47.793361 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f70389e7-7dfc-46d9-b020-245a57c366dc tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.159196 Aug 01 15:25:47.793918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 534/1076] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:47 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:47.804359 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.804940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:47.812259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.812691 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.813443 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.813869 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.878927 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:47.886381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c92486e-a9f1-4d6d-9c0f-2166c211d27d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.086204 Aug 01 15:25:47.887540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 535/1077] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:47 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:48.817095 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:48.817802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:48.825077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.825771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.826528 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.826992 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.959511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:48.969380 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:48.970912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:48.972075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8bdf8c4f-2238-4b67-9ead-97e493f91236 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.159052 Aug 01 15:25:48.972629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 536/1078] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:48 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:48.977078 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:48.977676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:48.983712 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.984160 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.984917 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.985344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:49.047300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:49.054771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d2bca35d-69fe-4b8e-b2d8-09e15dc5ea26 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1304 microversion: 2.1 time: 0.081172 Aug 01 15:25:49.055356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 537/1079] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:48 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:49.586131 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4541c47c-1382-485f-ab72-e88ecbf024f3 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.677591 Aug 01 15:25:49.587645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 543/1080] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:25:34 2022] POST /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments => generated 194 bytes in 14680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:49.997101 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:49.997718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:50.005127 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.005977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.007723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.008338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.033670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:50.077379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:50.078422 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:50.086120 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.086767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.087564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.087996 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.244045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:50.253436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:50.255796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:50.257266 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-567f1179-2827-43b4-bd72-531ea2351ce0 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.265401 Aug 01 15:25:50.271756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 538/1081] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:49 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:50.294802 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:50.303416 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9e596941-10da-448a-9426-dd1c73fef82c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.231123 Aug 01 15:25:50.304345 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 544/1082] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:50 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:50.894136 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-617f135c-8148-4cfc-90f9-37a2ca9dbf44 req-82896218-53ac-47af-97df-0fe8b5930be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604aa977-4208-40a5-aac6-5b476fa47320", "tag": "1756f97b-3f0e-4e43-b8e9-1a6f1676393f"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:50.903656 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-617f135c-8148-4cfc-90f9-37a2ca9dbf44 req-82896218-53ac-47af-97df-0fe8b5930be7 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.904102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-617f135c-8148-4cfc-90f9-37a2ca9dbf44 req-82896218-53ac-47af-97df-0fe8b5930be7 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.914744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-617f135c-8148-4cfc-90f9-37a2ca9dbf44 req-82896218-53ac-47af-97df-0fe8b5930be7 service nova] Creating event network-changed:1756f97b-3f0e-4e43-b8e9-1a6f1676393f for instance 604aa977-4208-40a5-aac6-5b476fa47320 on hv-cinder-84327 Aug 01 15:25:50.920133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-617f135c-8148-4cfc-90f9-37a2ca9dbf44 req-82896218-53ac-47af-97df-0fe8b5930be7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092294 Aug 01 15:25:50.920717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 539/1083] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:51.283307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:51.283999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:51.290806 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.291327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.292162 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.292852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.328984 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:51.330856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:51.340412 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.341126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.342420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.343297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.474421 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:51.483409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:51.484903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:51.486105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8472419f-ee04-49b7-82ec-19307b75b51a tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.206772 Aug 01 15:25:51.486691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 545/1084] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:51 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:51.530891 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:51.533628 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7a011c17-036f-454a-a433-baedbe0c60d9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.211915 Aug 01 15:25:51.534310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 540/1085] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:51 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:51.923217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-ac85ca65-79fe-405c-8cad-89dbb80860fe req-c8157b61-bf6d-4804-bde9-0a1a0a7eb4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "name": "network-vif-plugged", "status": "completed", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:51.932986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-ac85ca65-79fe-405c-8cad-89dbb80860fe req-c8157b61-bf6d-4804-bde9-0a1a0a7eb4ec service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.934188 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-ac85ca65-79fe-405c-8cad-89dbb80860fe req-c8157b61-bf6d-4804-bde9-0a1a0a7eb4ec service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.945315 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-ac85ca65-79fe-405c-8cad-89dbb80860fe req-c8157b61-bf6d-4804-bde9-0a1a0a7eb4ec service nova] Creating event network-vif-plugged:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:25:51.950249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-ac85ca65-79fe-405c-8cad-89dbb80860fe req-c8157b61-bf6d-4804-bde9-0a1a0a7eb4ec service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089507 Aug 01 15:25:51.951133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 546/1086] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:52.509416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:52.509976 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:52.516918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.517398 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.518158 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.518593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.555655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:52.556428 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:52.562850 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.563372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.564196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.564631 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.701216 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:52.709358 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:52.710982 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:52.712239 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ace02e32-588f-45bc-a8b7-5771ce19fc78 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.206903 Aug 01 15:25:52.712872 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 541/1087] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:52 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:52.727397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:52.735035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-51d09a11-c5e2-44ae-b34e-f4b7497dfbf4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.183465 Aug 01 15:25:52.735580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 547/1088] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:52 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:53.736513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.737178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:53.743754 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:53.744204 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.744969 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:53.745409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.754533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.755171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:53.762033 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:53.763102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.763887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:53.764831 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.956286 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:53.963030 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:53.964571 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:53.966087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:53.967482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c561bff6-ca4c-45e6-b6d4-d79c7acfd227 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.234966 Aug 01 15:25:53.968051 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 542/1089] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:53.970795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1fec7259-b5a6-4830-93c7-d23baa20353c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.220012 Aug 01 15:25:53.971361 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 548/1090] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:54.991419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:54.991906 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:54.992308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:54.992420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:54.998380 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:54.998526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:54.998859 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:54.999011 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:54.999633 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:54.999776 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:55.000068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:55.000213 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:55.196725 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:55.200659 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:55.205609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:55.207171 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:55.208350 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3839ecf0-1ce7-4eea-adde-792ef433a730 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.220945 Aug 01 15:25:55.208904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 543/1091] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:54 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:25:55.209751 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1ce3896b-66e8-45a3-b7b9-a3e2022b67b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.221794 Aug 01 15:25:55.210794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 549/1092] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:54 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:56.231793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:56.232335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:56.232750 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:56.232850 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:56.239986 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:56.240522 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:56.241220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:56.241443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:56.241961 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:56.242076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:56.243151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:56.243651 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:56.439006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:56.446762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94a5ccaf-b99a-4822-ab9e-e59f4e19ead8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.219235 Aug 01 15:25:56.446918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:56.447347 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 544/1093] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:56 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:56.467244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:56.468770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:56.469931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-77e92ed4-b726-4b72-80d4-e6be55e50a58 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.242337 Aug 01 15:25:56.470487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 550/1094] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:56 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:57.469983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:57.470572 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:57.477137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:57.477583 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:57.478348 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:57.478813 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:57.493335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:57.493937 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:57.500683 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:57.501203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:57.502021 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:57.502449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:57.691515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:57.700609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:57.702683 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-36a48225-d397-466c-925f-dc241a9fd00f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.236503 Aug 01 15:25:57.703367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 545/1095] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:57 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:57.709665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:57.711365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:57.712542 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b1a314d8-b3fa-468c-a8e5-613a218c6ff2 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1732 microversion: 2.20 time: 0.223160 Aug 01 15:25:57.722211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 551/1096] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:57 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:57.956898 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-027a0db2-6f7e-493d-bec0-0837f2742273 req-02a17558-ff03-40da-ba44-11f502a0f853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604aa977-4208-40a5-aac6-5b476fa47320", "name": "network-vif-plugged", "status": "completed", "tag": "1756f97b-3f0e-4e43-b8e9-1a6f1676393f"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:57.969035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-027a0db2-6f7e-493d-bec0-0837f2742273 req-02a17558-ff03-40da-ba44-11f502a0f853 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:57.969518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-027a0db2-6f7e-493d-bec0-0837f2742273 req-02a17558-ff03-40da-ba44-11f502a0f853 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:57.983884 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-027a0db2-6f7e-493d-bec0-0837f2742273 req-02a17558-ff03-40da-ba44-11f502a0f853 service nova] Creating event network-vif-plugged:1756f97b-3f0e-4e43-b8e9-1a6f1676393f for instance 604aa977-4208-40a5-aac6-5b476fa47320 on hv-cinder-84327 Aug 01 15:25:57.988744 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-027a0db2-6f7e-493d-bec0-0837f2742273 req-02a17558-ff03-40da-ba44-11f502a0f853 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Aug 01 15:25:57.989333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 546/1097] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:58.724864 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:58.725479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:58.732679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.733133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.733902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.734341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.737176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:58.737947 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:58.744195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.744635 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.745395 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.746527 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.923299 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:58.930868 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0a417d36-5bdb-4dbf-8a73-d7ca64ce31b2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.209930 Aug 01 15:25:58.931448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 552/1098] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:58 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:58.935806 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:58.943774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:58.945300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:58.946452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f95c9eb9-ef7c-4153-8b2a-bd21e4f85583 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1719 microversion: 2.20 time: 0.214098 Aug 01 15:25:58.947027 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 547/1099] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:25:58 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:25:59.262018 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:59.264323 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:59.270468 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.270932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.271720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.272143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.301705 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7380bb3f-8d09-4624-a9cd-78a5a964b1f4 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 01 15:25:59.302259 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 553/1100] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:25:59 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:59.312964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:59.313837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:59.321377 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.321858 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.323000 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.324255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.354297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-95d31575-a84f-4a83-b717-16e2614cff12 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/9d369282-c8e1-4d70-8848-d0216e498cde" status: 200 len: 194 microversion: 2.1 time: 0.045397 Aug 01 15:25:59.354900 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 548/1101] 10.222.0.100 () {58 vars in 1418 bytes} [Mon Aug 1 15:25:59 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/9d369282-c8e1-4d70-8848-d0216e498cde => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:59.952291 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:59.952889 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:59.959766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.960207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.960966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.961395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.095523 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:00.103059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-59e42031-b4aa-478a-949e-324b413d2a55 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1372 microversion: 2.1 time: 0.155010 Aug 01 15:26:00.103625 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 554/1102] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:25:59 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:00.677996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39eb9500-2260-4e73-b32e-d8220b4d7d06"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:00.680374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:00.686784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:00.687230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.687985 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:00.688419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.944445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5881537b-9b40-493c-9c9d-c53b62ea6c6f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "POST /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269994 Aug 01 15:26:00.945051 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 549/1103] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:26:00 2022] POST /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:01.125241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:01.125841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:01.132445 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.132879 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.133673 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.134067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.263851 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:01.271744 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c18dfead-cc3b-43a8-b2b8-6fe04b62341e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1562 microversion: 2.1 time: 0.150627 Aug 01 15:26:01.272373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 555/1104] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:01 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:01.294511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:01.295137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:01.301785 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.302227 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.303013 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.303440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.381515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0acc7691-baff-4294-8d8a-9b72db54c3f6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092997 Aug 01 15:26:01.382123 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 550/1105] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:26:01 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:02.617364 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-e9ceb121-8be2-4d95-9f37-903bf478213e req-e4d1bda2-075a-4c23-975c-4fb465556b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604aa977-4208-40a5-aac6-5b476fa47320", "tag": "1756f97b-3f0e-4e43-b8e9-1a6f1676393f"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:02.627998 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-e9ceb121-8be2-4d95-9f37-903bf478213e req-e4d1bda2-075a-4c23-975c-4fb465556b5e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.628452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-e9ceb121-8be2-4d95-9f37-903bf478213e req-e4d1bda2-075a-4c23-975c-4fb465556b5e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.641070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-e9ceb121-8be2-4d95-9f37-903bf478213e req-e4d1bda2-075a-4c23-975c-4fb465556b5e service nova] Creating event network-changed:1756f97b-3f0e-4e43-b8e9-1a6f1676393f for instance 604aa977-4208-40a5-aac6-5b476fa47320 on hv-cinder-84327 Aug 01 15:26:02.647325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-e9ceb121-8be2-4d95-9f37-903bf478213e req-e4d1bda2-075a-4c23-975c-4fb465556b5e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091794 Aug 01 15:26:02.647325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 556/1106] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:08.474137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:08.476426 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:08.483036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.483485 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.484246 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.484685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.513789 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-181bf936-bbc6-40d9-9cfa-60b622fb28fe tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044401 Aug 01 15:26:08.514334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 551/1107] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:26:08 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:08.654668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:08.655279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:08.662689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.663290 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.664079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.664524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.693163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d664b7cb-f2ad-451f-9735-83183e46666d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/9d369282-c8e1-4d70-8848-d0216e498cde" status: 200 len: 194 microversion: 2.1 time: 0.042928 Aug 01 15:26:08.693713 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 557/1108] 10.222.0.100 () {58 vars in 1418 bytes} [Mon Aug 1 15:26:08 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/9d369282-c8e1-4d70-8848-d0216e498cde => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:08.706238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:08.706715 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:08.712660 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.713113 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.713873 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.714311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.793174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lazy-loading 'services' on Instance uuid eb5aabbd-b880-4a6a-b291-445f618e7fa6 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:26:08.863870 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e58cd641-d894-4deb-a813-bd9549ed6aa1 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/9d369282-c8e1-4d70-8848-d0216e498cde" status: 202 len: 0 microversion: 2.1 time: 0.161971 Aug 01 15:26:08.864541 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 552/1109] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:26:08 2022] DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/9d369282-c8e1-4d70-8848-d0216e498cde => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:26:11.044970 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:11.045494 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:11.051977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.052418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.053174 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.053602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.084716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b8d048dc-58b3-4355-86be-5ba4b24ea320 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/39eb9500-2260-4e73-b32e-d8220b4d7d06" status: 200 len: 194 microversion: 2.1 time: 0.043173 Aug 01 15:26:11.085829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 558/1110] 10.222.0.100 () {58 vars in 1418 bytes} [Mon Aug 1 15:26:11 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/39eb9500-2260-4e73-b32e-d8220b4d7d06 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:11.099029 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:11.099618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:11.106537 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.107133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.107901 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.108340 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.187098 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lazy-loading 'services' on Instance uuid eb5aabbd-b880-4a6a-b291-445f618e7fa6 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:26:11.258746 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fbdfef16-57e3-4dc8-9ec8-6ae093130eef tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/39eb9500-2260-4e73-b32e-d8220b4d7d06" status: 202 len: 0 microversion: 2.1 time: 0.164499 Aug 01 15:26:11.259511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 553/1111] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:26:11 2022] DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments/39eb9500-2260-4e73-b32e-d8220b4d7d06 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:26:13.486869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:13.490350 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:13.497048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.498049 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.498880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.499317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.531778 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-eb06b5b2-c9db-4838-b489-03a26090fd57 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048906 Aug 01 15:26:13.532327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 559/1112] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:26:13 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:26:13.643355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:13.645666 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:13.652367 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.652842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.653595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.654028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.657682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:13.685958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-29e2b53f-ae5f-45e8-9667-3951d00af1da tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046831 Aug 01 15:26:13.686507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 554/1113] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:26:13 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:26:13.747092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:13.747671 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:13.754105 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.754556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.755352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.755791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.773486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:13.782190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:26:13.859650 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6b5c8e1d-b920-4854-8e38-53f112874599 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 204 len: 0 microversion: 2.1 time: 0.116743 Aug 01 15:26:13.860236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 560/1114] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:26:13 2022] DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:26:13.870112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:13.870804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:13.876835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.877283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.878046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.878482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:14.011938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:14.019502 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-26e0924a-76eb-4e44-9db7-3b85fb298cf2 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1676 microversion: 2.1 time: 0.153515 Aug 01 15:26:14.020074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 555/1115] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:13 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:15.042128 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:15.042929 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:15.045820 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:15.051318 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.051764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.052526 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.052961 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.185498 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:15.193268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5efece1c-d5e8-443e-b1b1-4b6bc068153c tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1676 microversion: 2.1 time: 0.155349 Aug 01 15:26:15.193841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 561/1116] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:15 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:16.214319 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:16.214959 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:16.221938 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:16.222389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:16.223199 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:16.223634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:16.356693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:16.364356 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-98d783c1-71ee-46fc-8dd2-470d611ba384 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1676 microversion: 2.1 time: 0.153911 Aug 01 15:26:16.364935 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 556/1117] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:16 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:17.385482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:17.386089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:17.393178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.393620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.394381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.394846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.459319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ea26c1f72445bb4cb50ea503600dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f123f171554a58a2dea8fcc2afbefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:17.469969 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-be69c508-f1d5-4bc9-9309-89b273c1aeb0 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 200 len: 1610 microversion: 2.1 time: 0.088339 Aug 01 15:26:17.470548 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 562/1118] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:17 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 1610 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:17.478480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-b6cf1a86-b05c-4d6a-b353-a23555aef611 req-0f4550dd-de71-4a90-ae01-fbfe801e6ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5aabbd-b880-4a6a-b291-445f618e7fa6", "name": "network-vif-deleted", "tag": "600628f5-2de3-4cb9-aa84-229c4faa76a4"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:17.490006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b6cf1a86-b05c-4d6a-b353-a23555aef611 req-0f4550dd-de71-4a90-ae01-fbfe801e6ad9 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.490585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b6cf1a86-b05c-4d6a-b353-a23555aef611 req-0f4550dd-de71-4a90-ae01-fbfe801e6ad9 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.502896 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-b6cf1a86-b05c-4d6a-b353-a23555aef611 req-0f4550dd-de71-4a90-ae01-fbfe801e6ad9 service nova] Creating event network-vif-deleted:600628f5-2de3-4cb9-aa84-229c4faa76a4 for instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 on hv-cinder-84327 Aug 01 15:26:17.508936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-b6cf1a86-b05c-4d6a-b353-a23555aef611 req-0f4550dd-de71-4a90-ae01-fbfe801e6ad9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040065 Aug 01 15:26:17.510819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 557/1119] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:18.491689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:18.492301 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:18.498921 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:18.499377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:18.500147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:18.500585 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:18.513729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] HTTP exception thrown: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Request method failure captured: Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 HTTP/1.1 Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kflepw2ropyaTxQ9Jd8mBhUpW3Vvvj9nbn6nbkDzBdYgXU7y6-NcWnTBocu_LBLQW3JhYApM9Zj0Locrv37VZwR-EbQE-I9jycqb0gBOQaQldcDWFLfnYqUSQdpbzMVA6d-ZkjDFGWAzT7bz4jla7V0BJzTHCSGTBMI1_XylKJNE Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:26:18.515388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_18f123f171554a58a2dea8fcc2afbefd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: f33ea26c1f72445bb4cb50ea503600dc Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:18.517086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'eb5aabbd-b880-4a6a-b291-445f618e7fa6'} Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:26:18.517911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:18.519369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:18.520609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Returning 404 to user: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:26:18.520609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9f6fd91a-f50f-42ce-a096-60f3549b13b6 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 404 len: 111 microversion: 2.1 time: 0.029031 Aug 01 15:26:18.520609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 563/1120] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:18 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:26:18.527050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0a417a2c-1dbd-4598-96c0-e34b2787ffb5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '.version_select at 0x7efd1d064c10>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:18.532195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0a417a2c-1dbd-4598-96c0-e34b2787ffb5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [6a18901c-eaea-4aee-a298-914f17f05f84] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 15:26:19.540431 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [None req-0a417a2c-1dbd-4598-96c0-e34b2787ffb5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [6a18901c-eaea-4aee-a298-914f17f05f84] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 51188. Aug 01 15:26:19.550909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=48 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:19.564484 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0a417a2c-1dbd-4598-96c0-e34b2787ffb5 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314252279" status: 202 len: 0 microversion: 2.1 time: 1.042280 Aug 01 15:26:19.565082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 558/1121] 10.222.0.100 () {58 vars in 1226 bytes} [Mon Aug 1 15:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314252279 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:26:22.449945 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:22.450782 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:22.457209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.457649 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.458452 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.458860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.471968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] HTTP exception thrown: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Request method failure captured: Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 HTTP/1.1 Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kflepw2ropyaTxQ9Jd8mBhUpW3Vvvj9nbn6nbkDzBdYgXU7y6-NcWnTBocu_LBLQW3JhYApM9Zj0Locrv37VZwR-EbQE-I9jycqb0gBOQaQldcDWFLfnYqUSQdpbzMVA6d-ZkjDFGWAzT7bz4jla7V0BJzTHCSGTBMI1_XylKJNE Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:26:22.473492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_18f123f171554a58a2dea8fcc2afbefd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: f33ea26c1f72445bb4cb50ea503600dc Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.475141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'eb5aabbd-b880-4a6a-b291-445f618e7fa6'} Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:26:22.476640 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.478046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.479434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Returning 404 to user: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:26:22.479434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-cf41d2bf-57c1-4ebb-b191-d62ed34eca03 tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 404 len: 111 microversion: 2.1 time: 0.028971 Aug 01 15:26:22.479434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 564/1122] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:26:22 2022] DELETE /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:26:22.484634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:22.485369 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: eb5aabbd-b880-4a6a-b291-445f618e7fa6] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:22.491573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.492026 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.492793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.493228 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.510880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] HTTP exception thrown: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Request method failure captured: Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 HTTP/1.1 Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3kflepw2ropyaTxQ9Jd8mBhUpW3Vvvj9nbn6nbkDzBdYgXU7y6-NcWnTBocu_LBLQW3JhYApM9Zj0Locrv37VZwR-EbQE-I9jycqb0gBOQaQldcDWFLfnYqUSQdpbzMVA6d-ZkjDFGWAzT7bz4jla7V0BJzTHCSGTBMI1_XylKJNE Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:26:22.512641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_18f123f171554a58a2dea8fcc2afbefd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: f33ea26c1f72445bb4cb50ea503600dc Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.514242 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'eb5aabbd-b880-4a6a-b291-445f618e7fa6'} Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:26:22.515167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. Aug 01 15:26:22.516526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:22.517668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Returning 404 to user: Instance eb5aabbd-b880-4a6a-b291-445f618e7fa6 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:26:22.517668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-549c5930-c0fb-43b2-870a-5049f9640e2f tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6" status: 404 len: 111 microversion: 2.1 time: 0.034389 Aug 01 15:26:22.517668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 559/1123] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:22 2022] GET /compute/v2.1/servers/eb5aabbd-b880-4a6a-b291-445f618e7fa6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:26:23.664568 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:23.665066 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:23.671734 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.672186 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.672954 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.673392 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.687291 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] HTTP exception thrown: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Request method failure captured: Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 HTTP/1.1 Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kflepw2ropyaTxQ9Jd8mBhUpW3Vvvj9nbn6nbkDzBdYgXU7y6-NcWnTBocu_LBLQW3JhYApM9Zj0Locrv37VZwR-EbQE-I9jycqb0gBOQaQldcDWFLfnYqUSQdpbzMVA6d-ZkjDFGWAzT7bz4jla7V0BJzTHCSGTBMI1_XylKJNE Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:26:23.688821 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_18f123f171554a58a2dea8fcc2afbefd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: f33ea26c1f72445bb4cb50ea503600dc Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.690459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': 'e6d7106b-88eb-481b-aa10-bbfffc0cd9f0'} Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:26:23.691324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.692588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.693818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Returning 404 to user: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:26:23.693818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ed034aea-6de2-41ae-9199-1f20292d3ece tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 404 len: 111 microversion: 2.1 time: 0.029757 Aug 01 15:26:23.693818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 565/1124] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:26:23 2022] DELETE /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:26:23.698486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:23.699111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] [instance: e6d7106b-88eb-481b-aa10-bbfffc0cd9f0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:23.706376 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.706845 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.707598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.708022 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.721049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] HTTP exception thrown: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Request method failure captured: Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 HTTP/1.1 Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3kflepw2ropyaTxQ9Jd8mBhUpW3Vvvj9nbn6nbkDzBdYgXU7y6-NcWnTBocu_LBLQW3JhYApM9Zj0Locrv37VZwR-EbQE-I9jycqb0gBOQaQldcDWFLfnYqUSQdpbzMVA6d-ZkjDFGWAzT7bz4jla7V0BJzTHCSGTBMI1_XylKJNE Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:26:23.722540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_18f123f171554a58a2dea8fcc2afbefd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/18f123f171554a58a2dea8fcc2afbefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 18f123f171554a58a2dea8fcc2afbefd Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-675463113 Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: f33ea26c1f72445bb4cb50ea503600dc Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-675463113-project Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.724195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': 'e6d7106b-88eb-481b-aa10-bbfffc0cd9f0'} Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:26:23.725060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. Aug 01 15:26:23.726288 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:26:23.727428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] Returning 404 to user: Instance e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:26:23.727428 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5136c231-3c3d-403b-8eaf-1f93f5b1c07d tempest-AttachVolumeTestJSON-675463113 tempest-AttachVolumeTestJSON-675463113-project] 10.222.0.100 "GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0" status: 404 len: 111 microversion: 2.1 time: 0.029261 Aug 01 15:26:23.727984 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 560/1125] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:26:23 2022] GET /compute/v2.1/servers/e6d7106b-88eb-481b-aa10-bbfffc0cd9f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:27:12.395580 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:12.396690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:12.398232 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6df8fcbb-92c2-486d-ac3c-01cc7c6dc606 req-a27f02f9-9dbb-4e0c-b7ba-f9fdbe9e3a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9", "tag": "765f0237-ede4-463a-95f5-ddf4142626e1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:12.399922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=9 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.400711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.404458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.405317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.405444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.406099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.406218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=22 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:12.406535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.414885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6df8fcbb-92c2-486d-ac3c-01cc7c6dc606 req-a27f02f9-9dbb-4e0c-b7ba-f9fdbe9e3a31 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.415418 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6df8fcbb-92c2-486d-ac3c-01cc7c6dc606 req-a27f02f9-9dbb-4e0c-b7ba-f9fdbe9e3a31 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.427209 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6df8fcbb-92c2-486d-ac3c-01cc7c6dc606 req-a27f02f9-9dbb-4e0c-b7ba-f9fdbe9e3a31 service nova] Creating event network-changed:765f0237-ede4-463a-95f5-ddf4142626e1 for instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 on hv-cinder-84327 Aug 01 15:27:12.436429 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6df8fcbb-92c2-486d-ac3c-01cc7c6dc606 req-a27f02f9-9dbb-4e0c-b7ba-f9fdbe9e3a31 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041998 Aug 01 15:27:12.437300 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 561/1126] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:12.439758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:12.525620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c0322534-60e5-4f88-b1c1-094a4dc074fb tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 204 len: 0 microversion: 2.1 time: 0.135015 Aug 01 15:27:12.526461 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 566/1127] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:27:12 2022] DELETE /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:27:12.535901 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:12.537058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:12.544943 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.545735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.547969 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.548416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.688703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:12.696534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-67a282fd-6889-4157-9d8e-b2fd5a5fc5e2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1579 microversion: 2.1 time: 0.165898 Aug 01 15:27:12.697137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 562/1128] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:12 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:13.719110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:13.719728 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:13.729083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:13.729083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:13.729869 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:13.730426 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:13.879410 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:13.887076 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9c34a5fe-2923-411c-a97c-3e4aeb8996af tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1579 microversion: 2.1 time: 0.172660 Aug 01 15:27:13.887624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 567/1129] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:13 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:14.909181 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:14.909786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:14.916341 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:14.916792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:14.917532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:14.917983 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:15.050463 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:15.058083 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1f60b719-b457-44f8-9806-099392e4199f tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1579 microversion: 2.1 time: 0.152810 Aug 01 15:27:15.058642 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 563/1130] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:14 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:16.080914 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:16.081675 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:16.088812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:16.089253 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:16.090012 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:16.090446 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:16.233024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:16.241141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f56f1cfd-b006-4752-b0f6-b1d8455199f7 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1579 microversion: 2.1 time: 0.164917 Aug 01 15:27:16.241845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 568/1131] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:16 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:17.091520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-cfc7700e-58b5-4ce2-b6f4-3785d21f8f0a req-13a73ed1-e418-418f-b2e9-e7d3791a1289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9", "name": "network-vif-deleted", "tag": "765f0237-ede4-463a-95f5-ddf4142626e1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:17.102157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cfc7700e-58b5-4ce2-b6f4-3785d21f8f0a req-13a73ed1-e418-418f-b2e9-e7d3791a1289 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.102606 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cfc7700e-58b5-4ce2-b6f4-3785d21f8f0a req-13a73ed1-e418-418f-b2e9-e7d3791a1289 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.114311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-cfc7700e-58b5-4ce2-b6f4-3785d21f8f0a req-13a73ed1-e418-418f-b2e9-e7d3791a1289 service nova] Creating event network-vif-deleted:765f0237-ede4-463a-95f5-ddf4142626e1 for instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 on hv-cinder-84327 Aug 01 15:27:17.118936 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-cfc7700e-58b5-4ce2-b6f4-3785d21f8f0a req-13a73ed1-e418-418f-b2e9-e7d3791a1289 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Aug 01 15:27:17.119817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 564/1132] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:17.263215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:17.263830 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:17.270286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.270770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.271536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.271978 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.333689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:17.341223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-17e5f7fd-bcfa-4aa1-850f-814a75f440b2 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1227 microversion: 2.1 time: 0.082006 Aug 01 15:27:17.341779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 569/1133] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:17 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1227 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:18.364366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:18.365060 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:18.371259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:18.371703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:18.372452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:18.372877 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:18.435264 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:18.442792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a3a92a41-b086-43cb-b2d5-66f7fd5419e4 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1227 microversion: 2.1 time: 0.083705 Aug 01 15:27:18.443349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 565/1134] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:18 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1227 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:19.464794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:19.465408 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:19.472539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:19.472991 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:19.473755 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:19.474199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:19.534588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:19.542677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c34ad365-2290-4b72-8533-22da5702a92e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1227 microversion: 2.1 time: 0.081700 Aug 01 15:27:19.543244 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 570/1135] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:19 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1227 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:20.563974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:20.564588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:20.571075 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.571528 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.572293 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.572732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.636690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:20.645036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7171f330-f5bb-45a7-852b-5e011af243f9 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1227 microversion: 2.1 time: 0.085487 Aug 01 15:27:20.645573 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 566/1136] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:20 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1227 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:21.665786 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:21.666395 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:21.673013 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.673465 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.674233 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.674814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.735314 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:21.743211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-36cb7a62-c6e8-4310-80e4-46fd754b50b5 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1227 microversion: 2.1 time: 0.081367 Aug 01 15:27:21.743766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 571/1137] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:21 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1227 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:22.764330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:22.764945 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:22.771489 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.771940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.772702 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.773138 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.803565 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.804009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.804462 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lazy-loading 'fault' on Instance uuid 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:22.845020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:22.854040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ffe159be-740f-474b-b570-5a4d7a66372a tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 200 len: 1232 microversion: 2.1 time: 0.093728 Aug 01 15:27:22.854710 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 567/1138] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:22 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 1232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:23.876847 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:23.877995 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:23.884741 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.885255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.886012 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.886439 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.899555 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] HTTP exception thrown: Instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 could not be found. Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Request method failure captured: Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 HTTP/1.1 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-5hErb8ovY5_w_WiBfbIfb8R2oHzuyr59JKxz7dp9wqQT-_OSzGnXaiMHP5egjWf-NsG0jy1n21zgTSTueqNZEtj-1x_YDqPiaRGEsHvRZECXVTwxJsFoXrUDBjzdyg472XrIcek2nS_afgs42a-0UG0-hXmLUim3-oDptHzPxROK0 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:23.901155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f44ad042ba9b4bdc91783fce54774c29", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: c6795a827b8d411aaa165db7b38435ce Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 could not be found. Aug 01 15:27:23.902852 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9'} Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 could not be found. Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:23.904004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 could not be found. Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 could not be found. Aug 01 15:27:23.905725 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:23.907546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Returning 404 to user: Instance 4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:23.907546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-42d7a696-0846-4fab-bd53-0f938c1f5f34 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9" status: 404 len: 111 microversion: 2.1 time: 0.029840 Aug 01 15:27:23.907546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 572/1139] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:23 2022] GET /compute/v2.1/servers/4b0d4955-4d8f-4466-b6f7-7473c3b4e7e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:27:26.984033 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-19c36946-e37d-4cc2-8443-01cc0f5e4072 req-505d6566-fa17-4e72-a471-5bc722838059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94042375-a5dd-4da8-9b2e-daba0cfbefb5", "tag": "47316b28-181a-4fa1-8973-c18fef74f52d"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:26.987237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:26.987757 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:26.998912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.003531 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-19c36946-e37d-4cc2-8443-01cc0f5e4072 req-505d6566-fa17-4e72-a471-5bc722838059 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.004255 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.005226 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.005822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.010544 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-19c36946-e37d-4cc2-8443-01cc0f5e4072 req-505d6566-fa17-4e72-a471-5bc722838059 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.022920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-19c36946-e37d-4cc2-8443-01cc0f5e4072 req-505d6566-fa17-4e72-a471-5bc722838059 service nova] Creating event network-changed:47316b28-181a-4fa1-8973-c18fef74f52d for instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 on hv-cinder-84327 Aug 01 15:27:27.028685 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-19c36946-e37d-4cc2-8443-01cc0f5e4072 req-505d6566-fa17-4e72-a471-5bc722838059 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048208 Aug 01 15:27:27.029817 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 573/1140] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:27.036974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:27.148410 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f541d7e9-71b9-4926-9230-6d8f95c80830 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 204 len: 0 microversion: 2.1 time: 0.172843 Aug 01 15:27:27.149471 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 568/1141] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:27:26 2022] DELETE /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:27:27.159449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:27.160547 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:27.172449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.173928 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.174947 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.175535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.356863 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:27.366496 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-47c8ae91-17f5-4290-adfd-abb4db08d274 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1578 microversion: 2.1 time: 0.212068 Aug 01 15:27:27.367635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 574/1142] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:27 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:28.388965 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:28.389808 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:28.396481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.397008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.397847 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.398354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.605812 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:28.614704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7d9d6eca-9be3-456f-adaa-248507f3966e tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1460 microversion: 2.1 time: 0.229912 Aug 01 15:27:28.615439 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 569/1143] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:28 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1460 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:28.825121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-46a41f13-3c0a-4b1d-b351-e67a1f7c91c4 req-d9e1d801-0ffd-437b-b3c8-4d8f7b0788d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94042375-a5dd-4da8-9b2e-daba0cfbefb5", "name": "network-vif-deleted", "tag": "47316b28-181a-4fa1-8973-c18fef74f52d"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:28.838525 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-46a41f13-3c0a-4b1d-b351-e67a1f7c91c4 req-d9e1d801-0ffd-437b-b3c8-4d8f7b0788d2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.838999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-46a41f13-3c0a-4b1d-b351-e67a1f7c91c4 req-d9e1d801-0ffd-437b-b3c8-4d8f7b0788d2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.850273 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-46a41f13-3c0a-4b1d-b351-e67a1f7c91c4 req-d9e1d801-0ffd-437b-b3c8-4d8f7b0788d2 service nova] Creating event network-vif-deleted:47316b28-181a-4fa1-8973-c18fef74f52d for instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 on hv-cinder-84327 Aug 01 15:27:28.855561 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-46a41f13-3c0a-4b1d-b351-e67a1f7c91c4 req-d9e1d801-0ffd-437b-b3c8-4d8f7b0788d2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033840 Aug 01 15:27:28.856317 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 575/1144] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:29.642261 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:29.644087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:29.653588 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.654411 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.655844 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.656508 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.704973 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.705786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.706396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lazy-loading 'fault' on Instance uuid 94042375-a5dd-4da8-9b2e-daba0cfbefb5 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:29.754109 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6795a827b8d411aaa165db7b38435ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44ad042ba9b4bdc91783fce54774c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:29.762052 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c2ad3bba-5684-4b4a-a9aa-b427868cc422 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 200 len: 1185 microversion: 2.1 time: 0.127637 Aug 01 15:27:29.762975 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 570/1145] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:29 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 1185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:30.786729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:30.787655 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 94042375-a5dd-4da8-9b2e-daba0cfbefb5] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:30.794243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:30.794714 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:30.795488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:30.795919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:30.811111 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] HTTP exception thrown: Instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 could not be found. Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Request method failure captured: Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 HTTP/1.1 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-5hErb8ovY5_w_WiBfbIfb8R2oHzuyr59JKxz7dp9wqQT-_OSzGnXaiMHP5egjWf-NsG0jy1n21zgTSTueqNZEtj-1x_YDqPiaRGEsHvRZECXVTwxJsFoXrUDBjzdyg472XrIcek2nS_afgs42a-0UG0-hXmLUim3-oDptHzPxROK0 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:30.812770 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f44ad042ba9b4bdc91783fce54774c29", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: c6795a827b8d411aaa165db7b38435ce Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 could not be found. Aug 01 15:27:30.814993 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '94042375-a5dd-4da8-9b2e-daba0cfbefb5'} Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 could not be found. Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:30.815836 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 could not be found. Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 could not be found. Aug 01 15:27:30.817311 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:30.819564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Returning 404 to user: Instance 94042375-a5dd-4da8-9b2e-daba0cfbefb5 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:30.819564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4550c7ba-d1fa-47ca-b150-12726fadde29 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5" status: 404 len: 111 microversion: 2.1 time: 0.033863 Aug 01 15:27:30.819564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 576/1146] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:30 2022] GET /compute/v2.1/servers/94042375-a5dd-4da8-9b2e-daba0cfbefb5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:27:31.314823 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:31.315520 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:31.321817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.322360 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.323173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.323671 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.342207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] HTTP exception thrown: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Request method failure captured: Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 HTTP/1.1 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-5hErb8ovY5_w_WiBfbIfb8R2oHzuyr59JKxz7dp9wqQT-_OSzGnXaiMHP5egjWf-NsG0jy1n21zgTSTueqNZEtj-1x_YDqPiaRGEsHvRZECXVTwxJsFoXrUDBjzdyg472XrIcek2nS_afgs42a-0UG0-hXmLUim3-oDptHzPxROK0 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:27:31.344064 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f44ad042ba9b4bdc91783fce54774c29", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: c6795a827b8d411aaa165db7b38435ce Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.346047 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '853a94ee-fe3a-4c55-bbd8-1b3fd6045150'} Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:31.346883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.348173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.349653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Returning 404 to user: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:31.349653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6d7fd667-d3ef-4c7e-a52e-0e1da8367122 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "DELETE /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 404 len: 111 microversion: 2.1 time: 0.035409 Aug 01 15:27:31.349653 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 571/1147] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:27:31 2022] DELETE /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:27:31.355539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:31.355662 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] [instance: 853a94ee-fe3a-4c55-bbd8-1b3fd6045150] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:31.362846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.363356 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.364149 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.369616 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.385737 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] HTTP exception thrown: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Request method failure captured: Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 HTTP/1.1 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-5hErb8ovY5_w_WiBfbIfb8R2oHzuyr59JKxz7dp9wqQT-_OSzGnXaiMHP5egjWf-NsG0jy1n21zgTSTueqNZEtj-1x_YDqPiaRGEsHvRZECXVTwxJsFoXrUDBjzdyg472XrIcek2nS_afgs42a-0UG0-hXmLUim3-oDptHzPxROK0 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:31.387321 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_f44ad042ba9b4bdc91783fce54774c29", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/f44ad042ba9b4bdc91783fce54774c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: f44ad042ba9b4bdc91783fce54774c29 Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1243777302 Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: c6795a827b8d411aaa165db7b38435ce Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestVolumeBootPattern-1243777302-project Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.388920 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '853a94ee-fe3a-4c55-bbd8-1b3fd6045150'} Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:31.393024 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. Aug 01 15:27:31.394635 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:31.395989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Returning 404 to user: Instance 853a94ee-fe3a-4c55-bbd8-1b3fd6045150 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:31.395989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4ab801b8-215a-47d4-8caf-e91867a8f267 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150" status: 404 len: 111 microversion: 2.1 time: 0.038223 Aug 01 15:27:31.395989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 577/1148] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:31 2022] GET /compute/v2.1/servers/853a94ee-fe3a-4c55-bbd8-1b3fd6045150 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:27:32.706837 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5664a0e0-a06c-4e7e-8602-0530ab9a6550 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] Calling method '.version_select at 0x7efd1d096ca0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:32.730830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5664a0e0-a06c-4e7e-8602-0530ab9a6550 tempest-TestVolumeBootPattern-1243777302 tempest-TestVolumeBootPattern-1243777302-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-505595786" status: 202 len: 0 microversion: 2.1 time: 0.028322 Aug 01 15:27:32.731753 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 572/1149] 10.222.0.100 () {58 vars in 1265 bytes} [Mon Aug 1 15:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-505595786 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:27:37.684243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:37.687381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:37.695168 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.696239 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.697229 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.697877 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.731431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4b83b8a4-2006-4ba2-89d4-0cab4c640cbd tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051082 Aug 01 15:27:37.732613 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 578/1150] 10.222.0.100 () {60 vars in 1348 bytes} [Mon Aug 1 15:27:37 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:37.810327 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:37.811032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:37.819302 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.819759 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.820556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.828915 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.868123 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:37.986074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ce73cce8-7718-409e-bb51-37f525b11db8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 204 len: 0 microversion: 2.20 time: 0.180119 Aug 01 15:27:37.987290 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 573/1151] 10.222.0.100 () {60 vars in 1285 bytes} [Mon Aug 1 15:27:37 2022] DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:27:37.997606 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:37.998857 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:38.006862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:38.007310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:38.008593 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:38.009058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:38.173346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:38.187887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:38.189733 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:38.192691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-57d22694-f670-46a0-8343-777e86cd9fd8 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.200939 Aug 01 15:27:38.193450 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 579/1152] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:27:37 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:39.219397 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:39.220154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:39.234058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.234465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.235263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.235738 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.523797 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:39.535978 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:39.537939 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:39.540436 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9a706894-b7c1-48a8-b38a-6fbbc2f531e6 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.327064 Aug 01 15:27:39.541470 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 574/1153] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:27:39 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:27:40.571564 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:40.572399 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:40.579211 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:40.579693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:40.580501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:40.580924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:40.915500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:40.923911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:40.925426 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424ccf230e16423a8dd32097d90c4995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb9ac7a058f47f39a01b9bd92c7f4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:40.927052 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7e8b337d-e206-4b52-a772-522ac2e5ab91 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 200 len: 1725 microversion: 2.20 time: 0.359219 Aug 01 15:27:40.927539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 580/1154] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:27:40 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:41.391948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2a25b580-687e-4d0c-9c25-ef5ac37fc01d req-49ff3a91-f136-40dc-b3ad-756eb5e24534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5bea0c-113f-48b4-a58b-6add2d371ea4", "name": "network-vif-deleted", "tag": "c3cf7331-4dc8-4def-a250-786622fdac10"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:41.402172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2a25b580-687e-4d0c-9c25-ef5ac37fc01d req-49ff3a91-f136-40dc-b3ad-756eb5e24534 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.402613 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2a25b580-687e-4d0c-9c25-ef5ac37fc01d req-49ff3a91-f136-40dc-b3ad-756eb5e24534 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.415486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2a25b580-687e-4d0c-9c25-ef5ac37fc01d req-49ff3a91-f136-40dc-b3ad-756eb5e24534 service nova] Creating event network-vif-deleted:c3cf7331-4dc8-4def-a250-786622fdac10 for instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 on hv-cinder-84327 Aug 01 15:27:41.421344 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2a25b580-687e-4d0c-9c25-ef5ac37fc01d req-49ff3a91-f136-40dc-b3ad-756eb5e24534 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Aug 01 15:27:41.422032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 575/1155] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:41.951565 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:41.952814 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:41.963868 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.964343 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.965110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.965551 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.990286 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] HTTP exception thrown: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Request method failure captured: Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 HTTP/1.1 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kD8Gug3x-fFzjoyeyKso5cLAJDwPhXLj_fachHJmOBm8JWYF9sLgPG3mH7IS-74rg4N_iaDq2INzA1gfoqRdRsfa23sMqHJHisYPV5_hC1mliUF7oP1pDjYZ_WpCJDM3NUvgjImO5lrhz0AyxD-p-qDWvz8TCSUPyhEhiA9rJva4 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:41.991892 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2bb9ac7a058f47f39a01b9bd92c7f4a2", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 424ccf230e16423a8dd32097d90c4995 Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:41.993327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '0f5bea0c-113f-48b4-a58b-6add2d371ea4'} Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:41.994107 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:41.995381 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:41.996487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Returning 404 to user: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:41.996487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1ee4de5b-14d4-49ed-b292-1b971bdb99f1 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 404 len: 111 microversion: 2.20 time: 0.045895 Aug 01 15:27:41.996487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 581/1156] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:27:41 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:27:42.012567 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fdfc9b5d-016b-45f3-96d0-7d73d9e30279 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '.version_select at 0x7efd1d4c1b80>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:42.049396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fdfc9b5d-016b-45f3-96d0-7d73d9e30279 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497209756" status: 204 len: 0 microversion: 2.20 time: 0.047224 Aug 01 15:27:42.051487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 576/1157] 10.222.0.100 () {60 vars in 1264 bytes} [Mon Aug 1 15:27:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497209756 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:27:43.870065 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:43.870574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:43.873069 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:43.879756 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.880266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.880983 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.881448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.887439 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:43.897867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] HTTP exception thrown: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Request method failure captured: Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 HTTP/1.1 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kD8Gug3x-fFzjoyeyKso5cLAJDwPhXLj_fachHJmOBm8JWYF9sLgPG3mH7IS-74rg4N_iaDq2INzA1gfoqRdRsfa23sMqHJHisYPV5_hC1mliUF7oP1pDjYZ_WpCJDM3NUvgjImO5lrhz0AyxD-p-qDWvz8TCSUPyhEhiA9rJva4 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:43.899617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2bb9ac7a058f47f39a01b9bd92c7f4a2", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 424ccf230e16423a8dd32097d90c4995 Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.901306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '0f5bea0c-113f-48b4-a58b-6add2d371ea4'} Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:43.902115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.903499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.904832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Returning 404 to user: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:43.904832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8f2c14b7-bfdc-4884-b239-09d14b38c112 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 404 len: 111 microversion: 2.20 time: 0.034754 Aug 01 15:27:43.904832 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 582/1158] 10.222.0.100 () {60 vars in 1285 bytes} [Mon Aug 1 15:27:43 2022] DELETE /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:27:43.909993 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:43.910761 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 0f5bea0c-113f-48b4-a58b-6add2d371ea4] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:43.912702 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:43.921997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.922486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.923789 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.924238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.931904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:43.944018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] HTTP exception thrown: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Request method failure captured: Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 HTTP/1.1 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3kD8Gug3x-fFzjoyeyKso5cLAJDwPhXLj_fachHJmOBm8JWYF9sLgPG3mH7IS-74rg4N_iaDq2INzA1gfoqRdRsfa23sMqHJHisYPV5_hC1mliUF7oP1pDjYZ_WpCJDM3NUvgjImO5lrhz0AyxD-p-qDWvz8TCSUPyhEhiA9rJva4 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:27:43.945923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2bb9ac7a058f47f39a01b9bd92c7f4a2", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 424ccf230e16423a8dd32097d90c4995 Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.947772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '0f5bea0c-113f-48b4-a58b-6add2d371ea4'} Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:43.948690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. Aug 01 15:27:43.950200 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:43.952069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Returning 404 to user: Instance 0f5bea0c-113f-48b4-a58b-6add2d371ea4 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:43.952069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f89172f-b29c-40f2-bb8f-7c2062e1d7c9 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4" status: 404 len: 111 microversion: 2.20 time: 0.041711 Aug 01 15:27:43.952069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 577/1159] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:27:43 2022] GET /compute/v2.1/servers/0f5bea0c-113f-48b4-a58b-6add2d371ea4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:27:45.097574 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.098064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.105618 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.106069 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.106862 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.107303 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.121208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] HTTP exception thrown: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Request method failure captured: Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba HTTP/1.1 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-3kD8Gug3x-fFzjoyeyKso5cLAJDwPhXLj_fachHJmOBm8JWYF9sLgPG3mH7IS-74rg4N_iaDq2INzA1gfoqRdRsfa23sMqHJHisYPV5_hC1mliUF7oP1pDjYZ_WpCJDM3NUvgjImO5lrhz0AyxD-p-qDWvz8TCSUPyhEhiA9rJva4 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:45.122781 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2bb9ac7a058f47f39a01b9bd92c7f4a2", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 424ccf230e16423a8dd32097d90c4995 Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.124490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '50052019-4694-4875-8915-9392814a8aba'} Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:45.125397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.126908 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.128499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Returning 404 to user: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:45.128499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-003e03d8-d817-4117-a2cf-b1cb6ba94633 tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 404 len: 111 microversion: 2.20 time: 0.031050 Aug 01 15:27:45.128499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 583/1160] 10.222.0.100 () {60 vars in 1285 bytes} [Mon Aug 1 15:27:45 2022] DELETE /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:27:45.132853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.133464 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] [instance: 50052019-4694-4875-8915-9392814a8aba] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.141279 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.141729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.142493 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.142964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.156333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] HTTP exception thrown: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Request method failure captured: Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba HTTP/1.1 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-3kD8Gug3x-fFzjoyeyKso5cLAJDwPhXLj_fachHJmOBm8JWYF9sLgPG3mH7IS-74rg4N_iaDq2INzA1gfoqRdRsfa23sMqHJHisYPV5_hC1mliUF7oP1pDjYZ_WpCJDM3NUvgjImO5lrhz0AyxD-p-qDWvz8TCSUPyhEhiA9rJva4 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:27:45.157874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2bb9ac7a058f47f39a01b9bd92c7f4a2", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2bb9ac7a058f47f39a01b9bd92c7f4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 2bb9ac7a058f47f39a01b9bd92c7f4a2 Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-600940349 Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 424ccf230e16423a8dd32097d90c4995 Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-600940349-project Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.160103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '50052019-4694-4875-8915-9392814a8aba'} Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:45.160974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. Aug 01 15:27:45.162423 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.163774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] Returning 404 to user: Instance 50052019-4694-4875-8915-9392814a8aba could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:45.163774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd2a3ef0-bf00-4e4b-8667-240dfb66b3aa tempest-AttachVolumeShelveTestJSON-600940349 tempest-AttachVolumeShelveTestJSON-600940349-project] 10.222.0.100 "GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba" status: 404 len: 111 microversion: 2.20 time: 0.031114 Aug 01 15:27:45.163774 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 578/1161] 10.222.0.100 () {60 vars in 1282 bytes} [Mon Aug 1 15:27:45 2022] GET /compute/v2.1/servers/50052019-4694-4875-8915-9392814a8aba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:27:54.252412 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ff6d93c0-0cdb-4129-a7cc-276a8c65aa9c tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d19aa60>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:54.301048 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ff6d93c0-0cdb-4129-a7cc-276a8c65aa9c tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/db2e81f4-f504-43b5-82c5-11487f0aa1b0" status: 200 len: 350 microversion: 2.1 time: 0.052384 Aug 01 15:27:54.302169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 584/1162] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:27:54 2022] GET /compute/v2.1/os-volumes/db2e81f4-f504-43b5-82c5-11487f0aa1b0 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:55.647618 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6061a295-00ad-452d-9f7d-288f4caa353a tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d2badc0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:55.654788 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:55.655500 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:55.697751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6061a295-00ad-452d-9f7d-288f4caa353a tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/c15ca940-dd19-4c83-a0e3-9272f436cadb" status: 200 len: 351 microversion: 2.1 time: 0.053713 Aug 01 15:27:55.697751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 579/1163] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:27:55 2022] GET /compute/v2.1/os-volumes/c15ca940-dd19-4c83-a0e3-9272f436cadb => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:57.032828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:57.033758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:57.038854 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-6b269bf5-841b-4bef-a8c1-6bb1ea499e28 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd21858040>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.087927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-6b269bf5-841b-4bef-a8c1-6bb1ea499e28 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/d1607184-a913-495d-87d6-0406d73c4dcf" status: 200 len: 351 microversion: 2.1 time: 0.055681 Aug 01 15:27:57.088492 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 585/1164] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes/d1607184-a913-495d-87d6-0406d73c4dcf => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:57.101596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ffe7a318-b180-4612-9aa3-6c574339ecc8 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d35aa60>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.186547 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ffe7a318-b180-4612-9aa3-6c574339ecc8 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089136 Aug 01 15:27:57.187163 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 580/1165] 10.222.0.100 () {58 vars in 1139 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:57.201407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c7ff0ea6-fb88-445d-989f-840b02ba4857 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1cc6f430>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.287957 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c7ff0ea6-fb88-445d-989f-840b02ba4857 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090507 Aug 01 15:27:57.288551 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 586/1166] 10.222.0.100 () {58 vars in 1154 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:57.303516 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c6ddb6e7-14a7-4399-b179-f53da7d13eda tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d5554c0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.394505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c6ddb6e7-14a7-4399-b179-f53da7d13eda tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094789 Aug 01 15:27:57.395197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 581/1167] 10.222.0.100 () {58 vars in 1139 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:57.407785 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-09028e83-9860-44f8-be92-6286ab4b6a35 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd219f1d30>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.496816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-09028e83-9860-44f8-be92-6286ab4b6a35 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092857 Aug 01 15:27:57.497793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 587/1168] 10.222.0.100 () {58 vars in 1172 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:57.511334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-080240e4-806e-4502-924f-b7ea9cfb71fa tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d1f1f70>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.598133 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-080240e4-806e-4502-924f-b7ea9cfb71fa tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090407 Aug 01 15:27:57.598783 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 582/1169] 10.222.0.100 () {58 vars in 1175 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:57.612487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9687bc60-b410-4875-be11-769fd8c58ed6 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d1a99d0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.699907 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9687bc60-b410-4875-be11-769fd8c58ed6 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091345 Aug 01 15:27:57.700917 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 588/1170] 10.222.0.100 () {58 vars in 1160 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:57.714197 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ae3b15d9-0113-4690-b4ed-1198d466cc11 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1d2bb9d0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.805940 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ae3b15d9-0113-4690-b4ed-1198d466cc11 tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095665 Aug 01 15:27:57.806786 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 583/1171] 10.222.0.100 () {58 vars in 1193 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:57.820198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-17c4b565-15a3-45a5-acd3-c8df7229724b tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] Calling method '.version_select at 0x7efd1cc7ea60>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.905011 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-17c4b565-15a3-45a5-acd3-c8df7229724b tempest-VolumesTestJSON-29382525 tempest-VolumesTestJSON-29382525-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088811 Aug 01 15:27:57.905576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 589/1172] 10.222.0.100 () {58 vars in 1160 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:58.472779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:58.473897 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.479883 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.480329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.481083 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.481519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.503699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-97983617-1467-452c-bd29-d000463153a5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/ips" status: 200 len: 150 microversion: 2.1 time: 0.035297 Aug 01 15:27:58.504767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 584/1173] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:27:58 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:58.516742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:58.519139 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.525843 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.526282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.527058 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.527490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.604617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Invalid volume: volume 8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f is already attached to instances: 50fe1da9-6f4b-4843-ab47-523d01773f03 Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: POST /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/os-volume_attachments HTTP/1.1 Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 74 Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:27:58.606228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {"volumeAttachment": {"volumeId": "8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f"}} Aug 01 15:27:58.607931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Invalid volume: volume 8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f is already attached to instances: 50fe1da9-6f4b-4843-ab47-523d01773f03 Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'server_id': '604aa977-4208-40a5-aac6-5b476fa47320', 'body': {'volumeAttachment': {'volumeId': '8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f'}}} Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f is already attached to instances: 50fe1da9-6f4b-4843-ab47-523d01773f03 Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:58.609163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f is already attached to instances: 50fe1da9-6f4b-4843-ab47-523d01773f03 Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:58.610646 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f is already attached to instances: 50fe1da9-6f4b-4843-ab47-523d01773f03 Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 400 to user: Invalid volume: volume 8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f is already attached to instances: 50fe1da9-6f4b-4843-ab47-523d01773f03 {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9a1f2e92-c59f-4106-b0e2-71a3aa7967af tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095515 Aug 01 15:27:58.612400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 590/1174] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:27:58 2022] POST /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:27:58.616297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:58.616795 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.622836 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.623283 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.624035 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.624468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.649513 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:58.726761 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f84ddc6-ea00-4079-87fb-5784331be024 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 204 len: 0 microversion: 2.1 time: 0.112965 Aug 01 15:27:58.727342 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 585/1175] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:27:58 2022] DELETE /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:27:58.735535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:58.736147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.744245 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.744701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.745478 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.745937 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.873738 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:58.881797 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-de3d4013-4191-45f0-bd5a-ae3b7e84ba79 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1687 microversion: 2.1 time: 0.150156 Aug 01 15:27:58.882359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 591/1176] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:58 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:59.904407 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:59.905104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:59.912229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.912667 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.913416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.913842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.041182 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:00.048637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-efb48ba9-93b9-4674-a171-3b152bd4029d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1687 microversion: 2.1 time: 0.148487 Aug 01 15:28:00.049487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 586/1177] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:27:59 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:01.070113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:01.070759 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:01.077551 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.078001 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.078802 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.079243 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.330143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:01.338284 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-aca47229-af30-4c8e-9dca-90bf05213d48 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1687 microversion: 2.1 time: 0.272159 Aug 01 15:28:01.352588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 592/1178] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:01 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1687 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:01.786816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4bc60cf7-44d1-4017-995f-0dc4af54ac1e req-abcbd3a2-ff57-4fd6-a912-612b305e0a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604aa977-4208-40a5-aac6-5b476fa47320", "name": "network-vif-deleted", "tag": "1756f97b-3f0e-4e43-b8e9-1a6f1676393f"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:01.798758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4bc60cf7-44d1-4017-995f-0dc4af54ac1e req-abcbd3a2-ff57-4fd6-a912-612b305e0a75 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.799237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4bc60cf7-44d1-4017-995f-0dc4af54ac1e req-abcbd3a2-ff57-4fd6-a912-612b305e0a75 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.839690 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4bc60cf7-44d1-4017-995f-0dc4af54ac1e req-abcbd3a2-ff57-4fd6-a912-612b305e0a75 service nova] Creating event network-vif-deleted:1756f97b-3f0e-4e43-b8e9-1a6f1676393f for instance 604aa977-4208-40a5-aac6-5b476fa47320 on hv-cinder-84327 Aug 01 15:28:01.845480 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4bc60cf7-44d1-4017-995f-0dc4af54ac1e req-abcbd3a2-ff57-4fd6-a912-612b305e0a75 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062298 Aug 01 15:28:01.846077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 587/1179] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:02.362369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:02.364196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:02.372825 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.373645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.374684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.375120 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.410416 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.411419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.411887 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lazy-loading 'fault' on Instance uuid 604aa977-4208-40a5-aac6-5b476fa47320 {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:02.459403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:02.467951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7721f531-1284-4f89-b1e7-11ba3ce4bb5c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 200 len: 1336 microversion: 2.1 time: 0.110916 Aug 01 15:28:02.468813 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 593/1180] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:02 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:03.490187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:03.490919 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:03.497115 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.497567 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.498621 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.499087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.512473 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 HTTP/1.1 Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:28:03.514153 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:28:03.515966 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '604aa977-4208-40a5-aac6-5b476fa47320'} Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:03.517102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:28:03.518630 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:03.520763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:03.520763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0d10877a-dc18-49d8-98fb-3c42fd1f9e57 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 404 len: 111 microversion: 2.1 time: 0.030120 Aug 01 15:28:03.520763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 588/1181] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:03 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:28:03.527035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5149138f-f14c-453a-ad6d-10753696c951 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '.version_select at 0x7efd1dad5790>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:03.556748 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5149138f-f14c-453a-ad6d-10753696c951 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845186826" status: 202 len: 0 microversion: 2.1 time: 0.034878 Aug 01 15:28:03.557319 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 594/1182] 10.222.0.100 () {58 vars in 1226 bytes} [Mon Aug 1 15:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845186826 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:04.237691 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.238263 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.244999 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.245526 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.246309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.246758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.336532 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lazy-loading 'services' on Instance uuid 50fe1da9-6f4b-4843-ab47-523d01773f03 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:04.418276 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c54efb14-954f-4ed4-ae15-20901dd29bb7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments/8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f" status: 202 len: 0 microversion: 2.1 time: 0.184237 Aug 01 15:28:04.422748 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 589/1183] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:28:04 2022] DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments/8f54c704-79a7-4bcf-a4fc-e7e3a070ac3f => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:04.430874 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.433425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.443004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.443372 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.444396 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.445203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.499411 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-1f44f9be-0c6a-438e-9221-35db3ab1976b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074323 Aug 01 15:28:04.499949 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 595/1184] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:05.512314 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:05.514847 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:05.521440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.521821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.522592 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.523082 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.553719 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1780ebcc-a8ef-4625-b62f-67011244c83f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046207 Aug 01 15:28:05.554280 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 590/1185] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:28:05 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:28:05.623538 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:05.624155 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:05.632365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.632922 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.634126 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.634691 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.662106 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:28:05.741266 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7bb31d56-bbdb-43ae-b027-df36c214dba0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 204 len: 0 microversion: 2.1 time: 0.121965 Aug 01 15:28:05.741855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 596/1186] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:28:05 2022] DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:28:05.750070 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:05.750698 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:05.756817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.757354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.758128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.759006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.897706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:05.905224 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-965f5e0c-cfab-4f33-8848-c957635fe9e0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1685 microversion: 2.1 time: 0.158932 Aug 01 15:28:05.905792 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 591/1187] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:05 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:06.667767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:28:06.668265 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Mon Aug 1 15:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:28:06.928086 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:06.928793 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:06.935310 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.935764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.936624 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.937063 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:07.075008 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:07.084401 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0e3e85c4-5f1e-4cbf-ab8e-16ad2b1329e9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1685 microversion: 2.1 time: 0.161071 Aug 01 15:28:07.084983 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 597/1188] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:06 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:08.108305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:08.109069 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:08.116351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:08.116892 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:08.117844 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:08.118310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:08.328354 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:08.339163 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9b2a8256-3596-4cf4-ba04-bb729a18ccfe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 200 len: 1685 microversion: 2.1 time: 0.236265 Aug 01 15:28:08.339868 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 592/1189] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:08 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 1685 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:08.700205 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-cc895127-f60c-4c98-bde3-df961b2f6a24 req-4e581a6f-fe2b-476d-bdaf-579447e95479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50fe1da9-6f4b-4843-ab47-523d01773f03", "name": "network-vif-deleted", "tag": "75f05372-caf7-4de3-b9f9-38fad2b1a78c"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:08.713944 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-cc895127-f60c-4c98-bde3-df961b2f6a24 req-4e581a6f-fe2b-476d-bdaf-579447e95479 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:08.714387 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-cc895127-f60c-4c98-bde3-df961b2f6a24 req-4e581a6f-fe2b-476d-bdaf-579447e95479 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:08.727818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-cc895127-f60c-4c98-bde3-df961b2f6a24 req-4e581a6f-fe2b-476d-bdaf-579447e95479 service nova] Creating event network-vif-deleted:75f05372-caf7-4de3-b9f9-38fad2b1a78c for instance 50fe1da9-6f4b-4843-ab47-523d01773f03 on hv-cinder-84327 Aug 01 15:28:08.736080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-cc895127-f60c-4c98-bde3-df961b2f6a24 req-4e581a6f-fe2b-476d-bdaf-579447e95479 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Aug 01 15:28:08.736808 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 598/1190] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:09.361338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:09.362111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:09.371061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.371715 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.372602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.373419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.389154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 HTTP/1.1 Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:28:09.391032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:28:09.392718 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '50fe1da9-6f4b-4843-ab47-523d01773f03'} Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:09.393645 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:28:09.398596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:28:09.400298 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:09.400298 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa1a224e-f5e8-4fe6-9f87-463c8a15b8fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 404 len: 111 microversion: 2.1 time: 0.035916 Aug 01 15:28:09.400298 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 593/1191] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:09 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:28:09.404497 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8644f676-a71d-4448-af62-f727851739fe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '.version_select at 0x7efd1dad5f70>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:09.428367 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8644f676-a71d-4448-af62-f727851739fe tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-370080721" status: 202 len: 0 microversion: 2.1 time: 0.028517 Aug 01 15:28:09.428992 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 599/1192] 10.222.0.100 () {58 vars in 1223 bytes} [Mon Aug 1 15:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-370080721 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:10.119061 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6fe6ca7e-9317-4919-9aec-4002bef49b3d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: .version_select at 0x7efd1d2bbd30>, body: {"keypair": {"name": "tempest-keypair-640828723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjyZEUwMF3ATfeokuvZ/YaI2ln+VhSZl3CK3Q03Ylfx4LCVqZnVPI535ixonNK1e5yW4o/N5yIUJ/m0b2EqRxVXZiRnIW++kt5bQ5Jp//hggULF/tpGflktn6RRqg+71A=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:10.135332 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-6fe6ca7e-9317-4919-9aec-4002bef49b3d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:10.139790 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-6fe6ca7e-9317-4919-9aec-4002bef49b3d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:10.162220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6fe6ca7e-9317-4919-9aec-4002bef49b3d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047731 Aug 01 15:28:10.162855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 594/1193] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:28:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:11.500766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-565498925", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64714ec3-4fee-42c0-bc82-5b770c41babf"}], "security_groups": [{"name": "tempest-securitygroup--2014023591"}], "key_name": "tempest-keypair-640828723", "user_data": "}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:11.616951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] validate_networks() for [('64714ec3-4fee-42c0-bc82-5b770c41babf', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:28:12.116910 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:28:12.117334 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:28:12.117813 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:28:12.118221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:28:12.118630 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:28:12.127385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:12.127828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:12.128621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:12.129581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:12.146484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:12.150340 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:12.161272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:28:12.163638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:28:12.211323 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a32cd1a9-a291-4e58-b9a6-8a04671d09da tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.715336 Aug 01 15:28:12.211960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 600/1194] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:28:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:28:12.223530 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29ea07fd-15c7-49f6-a7a4-9eb3ce01a094 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:12.224174 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-29ea07fd-15c7-49f6-a7a4-9eb3ce01a094 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:12.280245 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-29ea07fd-15c7-49f6-a7a4-9eb3ce01a094 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:12.288402 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-29ea07fd-15c7-49f6-a7a4-9eb3ce01a094 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1244 microversion: 2.1 time: 0.069371 Aug 01 15:28:12.288969 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 595/1195] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:12 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:13.310023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:13.310894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:13.317279 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:13.317856 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:13.318688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:13.319344 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:13.404255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:13.412966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fd650adc-1556-4892-8827-c463d766cafc tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1304 microversion: 2.1 time: 0.107429 Aug 01 15:28:13.413556 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 601/1196] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:13 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:14.434049 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:14.434901 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:14.442556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:14.443025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:14.444073 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:14.444970 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:14.873234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:14.880661 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c642b7bc-d61c-42df-899a-934fb272c107 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.450457 Aug 01 15:28:14.881234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 596/1197] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:14 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:15.141294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-345c76ad-cc53-4f0a-a825-daa1f48683d3 req-6841aa5e-d6ea-41ce-b395-52f6b06b0e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c58cce0-c162-41f8-9cbb-eb578485e07b", "tag": "89c6f5a9-cd74-4c97-ae0b-caa7878a8e08"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:15.152236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-345c76ad-cc53-4f0a-a825-daa1f48683d3 req-6841aa5e-d6ea-41ce-b395-52f6b06b0e53 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:15.152681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-345c76ad-cc53-4f0a-a825-daa1f48683d3 req-6841aa5e-d6ea-41ce-b395-52f6b06b0e53 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:15.163528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-345c76ad-cc53-4f0a-a825-daa1f48683d3 req-6841aa5e-d6ea-41ce-b395-52f6b06b0e53 service nova] Creating event network-changed:89c6f5a9-cd74-4c97-ae0b-caa7878a8e08 for instance 1c58cce0-c162-41f8-9cbb-eb578485e07b on hv-cinder-84327 Aug 01 15:28:15.168413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-345c76ad-cc53-4f0a-a825-daa1f48683d3 req-6841aa5e-d6ea-41ce-b395-52f6b06b0e53 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030670 Aug 01 15:28:15.169207 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 602/1198] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:16.027827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:16.028435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:16.034506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:16.035046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:16.036102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:16.036594 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:16.173639 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:16.181608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81ef8c31-ef1e-4bcc-8908-b56e4e2067bf tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.283942 Aug 01 15:28:16.182157 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 597/1199] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:15 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:17.204133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:17.204748 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:17.211517 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:17.211968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:17.212736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:17.213172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:17.346422 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:17.353716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3e51e59e-d13e-4f5d-b0b4-fc224b0d4bdb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.154847 Aug 01 15:28:17.354283 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 603/1200] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:17 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:18.373486 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:18.374068 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:18.381141 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:18.381688 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:18.382452 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:18.382915 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:18.515509 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:18.523254 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b0b36ce7-a7b2-4096-a20f-113cfb9770dd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.153752 Aug 01 15:28:18.523814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 598/1201] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:18 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:19.543681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:19.544299 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:19.551263 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:19.551800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:19.552643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:19.553183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:19.689848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:19.698294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-0bfeac42-dba5-4cca-a284-35497447b848 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.158397 Aug 01 15:28:19.698972 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 604/1202] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:19 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:20.719303 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:20.719913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:20.727187 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:20.727638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:20.728409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:20.728880 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:20.865435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:20.874063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3ce7cca0-a551-4edd-8843-500465f98d21 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.158555 Aug 01 15:28:20.874622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 599/1203] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:20 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:21.896745 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:21.897507 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:21.906006 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4258fb84-9b0d-4e33-a655-c689aaded84f req-2b8955c2-69a5-4a68-88b7-b03ebccc1442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58cce0-c162-41f8-9cbb-eb578485e07b", "name": "network-vif-plugged", "status": "completed", "tag": "89c6f5a9-cd74-4c97-ae0b-caa7878a8e08"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:21.915795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:21.916238 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:21.917143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:21.917677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:21.918634 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4258fb84-9b0d-4e33-a655-c689aaded84f req-2b8955c2-69a5-4a68-88b7-b03ebccc1442 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:21.919097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4258fb84-9b0d-4e33-a655-c689aaded84f req-2b8955c2-69a5-4a68-88b7-b03ebccc1442 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:21.932184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4258fb84-9b0d-4e33-a655-c689aaded84f req-2b8955c2-69a5-4a68-88b7-b03ebccc1442 service nova] Creating event network-vif-plugged:89c6f5a9-cd74-4c97-ae0b-caa7878a8e08 for instance 1c58cce0-c162-41f8-9cbb-eb578485e07b on hv-cinder-84327 Aug 01 15:28:21.938262 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4258fb84-9b0d-4e33-a655-c689aaded84f req-2b8955c2-69a5-4a68-88b7-b03ebccc1442 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036311 Aug 01 15:28:21.939505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 600/1204] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:22.136247 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:22.156610 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:22.183413 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:22.190959 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-33294b06-005c-4052-8d42-e104674c4889 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.299553 Aug 01 15:28:22.191994 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 605/1205] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:21 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:23.214179 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:23.214909 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:23.216836 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:23.223374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.223817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.224571 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.225004 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.357076 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:23.365114 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c107872-e807-4d24-9141-591f299c0d94 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1370 microversion: 2.1 time: 0.155139 Aug 01 15:28:23.365668 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 601/1206] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:23 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:24.385352 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:24.385953 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:24.392268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:24.392711 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:24.393465 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:24.393891 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:24.530530 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:24.538880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d2140b25-4326-4c30-b958-070cbbc54bee tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1559 microversion: 2.1 time: 0.157329 Aug 01 15:28:24.539437 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 606/1207] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:28:24 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:24.559164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:24.559659 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:24.566032 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:24.566477 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:24.567270 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:24.567704 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:24.646793 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f1ee76b4-c446-4672-ae79-ed5fc1133f8c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091399 Aug 01 15:28:24.647445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 602/1208] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:28:24 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:25.565099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-9036b0c4-c3e9-47c4-b9bd-d00c6b487c4c req-8f1a7d4e-e57d-4d61-b13f-3d97ac333851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c58cce0-c162-41f8-9cbb-eb578485e07b", "tag": "89c6f5a9-cd74-4c97-ae0b-caa7878a8e08"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:25.576333 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-9036b0c4-c3e9-47c4-b9bd-d00c6b487c4c req-8f1a7d4e-e57d-4d61-b13f-3d97ac333851 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.576780 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-9036b0c4-c3e9-47c4-b9bd-d00c6b487c4c req-8f1a7d4e-e57d-4d61-b13f-3d97ac333851 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.588827 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-9036b0c4-c3e9-47c4-b9bd-d00c6b487c4c req-8f1a7d4e-e57d-4d61-b13f-3d97ac333851 service nova] Creating event network-changed:89c6f5a9-cd74-4c97-ae0b-caa7878a8e08 for instance 1c58cce0-c162-41f8-9cbb-eb578485e07b on hv-cinder-84327 Aug 01 15:28:25.594237 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-9036b0c4-c3e9-47c4-b9bd-d00c6b487c4c req-8f1a7d4e-e57d-4d61-b13f-3d97ac333851 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032754 Aug 01 15:28:25.595037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 607/1209] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:03.070637 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:03.077787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:03.303705 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-31bd5063-2546-40ae-ba06-dd5f0ffb94c8 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Action: 'create', calling method: .version_select at 0x7efd1d35a8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1707530113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAayo143MhboI7F3bDJ4wNYZl4UtBICc0RUAohm72shwwOJmK/FtuKtPLaf3dbS2VogITIVTzx8E12auhoy0ryhezOPZ3Iot3+YqtbRZ5046AZHYIMbo1xmiaWYN/Yoppg=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:03.321142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-31bd5063-2546-40ae-ba06-dd5f0ffb94c8 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Getting quotas for project 7cf605507bae49a0a797b96db9da31bd. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:29:03.325609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-31bd5063-2546-40ae-ba06-dd5f0ffb94c8 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Getting quotas for user 250e40933543431981bcb19db78fa144 and project 7cf605507bae49a0a797b96db9da31bd. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:29:03.349087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-31bd5063-2546-40ae-ba06-dd5f0ffb94c8 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.284911 Aug 01 15:29:03.350312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 603/1210] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:29:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:27.948045 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:27.948809 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:27.953897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-841090129", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1707530113", "security_groups": [{"name": "tempest-secgroup-smoke-1421437262"}], "networks": [{"uuid": "769583b6-ba5b-464b-9204-47a25250aceb"}], "block_device_mapping_v2": [{"uuid": "7a150333-b938-4c0d-a522-b11d41039218", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:28.070114 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] validate_networks() for [('769583b6-ba5b-464b-9204-47a25250aceb', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:29:28.434351 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:29:28.434812 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:29:28.435292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:29:28.435701 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:29:28.436113 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:29:28.444923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:28.445369 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:28.446166 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:28.446604 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:28.464512 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Getting quotas for project 7cf605507bae49a0a797b96db9da31bd. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:29:28.468576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Getting quotas for user 250e40933543431981bcb19db78fa144 and project 7cf605507bae49a0a797b96db9da31bd. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:29:28.524370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:29:28.526688 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a150333-b938-4c0d-a522-b11d41039218',volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:29:28.659083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ed7195aa-0b7a-4518-a82d-cbc4f9fcd262 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.712883 Aug 01 15:29:28.659715 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 608/1211] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:29:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:29:28.671600 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8a3556b1-59bd-4314-9abd-b9527757628e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:28.672219 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8a3556b1-59bd-4314-9abd-b9527757628e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:28.674818 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:28.676505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:28.730781 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8a3556b1-59bd-4314-9abd-b9527757628e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:28.737442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8a3556b1-59bd-4314-9abd-b9527757628e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1091 microversion: 2.1 time: 0.070102 Aug 01 15:29:28.738002 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 604/1212] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:28 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1091 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:29.760219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:29.763235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:29.770687 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:29.771208 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.772521 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:29.773178 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.844004 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:29.853469 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d2850390-c34e-4ca2-b661-5df66b8b373e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1207 microversion: 2.1 time: 0.099654 Aug 01 15:29:29.854042 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 609/1213] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:29 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:30.874450 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:30.875349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:30.881686 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:30.882129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:30.883139 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:30.883577 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.078535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-0f0d0347-dc1b-47fb-82b7-5516a0f43c29 req-e8e817de-d2b1-46ca-b321-5cffcace6cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:31.091206 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0f0d0347-dc1b-47fb-82b7-5516a0f43c29 req-e8e817de-d2b1-46ca-b321-5cffcace6cf2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:31.091644 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-0f0d0347-dc1b-47fb-82b7-5516a0f43c29 req-e8e817de-d2b1-46ca-b321-5cffcace6cf2 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.104842 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-0f0d0347-dc1b-47fb-82b7-5516a0f43c29 req-e8e817de-d2b1-46ca-b321-5cffcace6cf2 service nova] Creating event network-changed:515ef845-da04-4f16-bcd5-2ad3a435334b for instance 606055df-c608-4042-a2f4-c99ccca2367e on hv-cinder-84327 Aug 01 15:29:31.108906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:31.110420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-0f0d0347-dc1b-47fb-82b7-5516a0f43c29 req-e8e817de-d2b1-46ca-b321-5cffcace6cf2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036196 Aug 01 15:29:31.111388 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 610/1214] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:31.119329 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1f5bc784-c4ad-457a-86e1-a059c644e472 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.248617 Aug 01 15:29:31.119988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 605/1215] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:30 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:32.141594 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:32.142300 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:32.150377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.151009 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.152346 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.153130 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.284429 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:32.293420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-bc2b6c41-e4f4-406b-a663-cb40d07c953d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.156126 Aug 01 15:29:32.293989 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 611/1216] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:32 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:33.314989 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:33.315627 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:33.322162 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:33.323147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:33.323962 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:33.324396 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:33.457167 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:33.464801 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-67531a62-fb5f-4cd9-a727-fa47c6f90e6b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.154596 Aug 01 15:29:33.465353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 606/1217] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:33 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:34.485462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:34.486156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:34.492621 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.493085 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.493828 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.494261 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.626897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:34.634294 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4e4ea1a3-003f-44ed-8d82-471120ca3712 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.152823 Aug 01 15:29:34.634888 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 612/1218] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:34 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:35.655543 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:35.656195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:35.662890 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:35.663351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:35.664112 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:35.664551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:35.794497 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:35.802045 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fc073acc-de87-4703-bddf-13de46053087 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.150216 Aug 01 15:29:35.803050 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 607/1219] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:35 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:36.822312 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:36.822927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:36.829671 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:36.830219 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:36.830918 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:36.831359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:36.959890 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:36.967370 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-11b7024c-759c-43b1-81ad-0f37224fff35 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.148907 Aug 01 15:29:36.967924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 613/1220] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:36 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:37.988534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:37.989142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:37.996230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:37.996676 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:37.997432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:37.997864 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:38.124465 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:38.131867 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ef231df7-f48a-464e-a510-fdcd855b1d78 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.147263 Aug 01 15:29:38.132445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 608/1221] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:37 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:39.151886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:39.152483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:39.154906 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:39.155712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:39.161246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:39.161686 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:39.162435 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:39.162895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:39.294984 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:39.303115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-791a856a-6960-458c-9cfb-4faf183bd56e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.155102 Aug 01 15:29:39.303679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 614/1222] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:39 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:40.324996 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:40.325856 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:40.327981 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:40.335756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:40.336622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:40.337625 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:40.338353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:40.539907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:40.547522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7454eee-5ba0-4cc4-b62d-70c7308d2430 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.226187 Aug 01 15:29:40.548207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 609/1223] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:40 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:41.569161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:41.569768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:41.576449 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.576889 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.577638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.578091 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.959302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:41.966588 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a5318ffe-aa73-4f8a-a829-c22df61e350d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.401766 Aug 01 15:29:41.967180 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 615/1224] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:41 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:42.296342 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-9ef6bb2b-57f0-4d52-9a42-5a1de577665c req-1166e616-1cb7-4a47-afd1-af3136405557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "name": "network-vif-plugged", "status": "completed", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:42.307649 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9ef6bb2b-57f0-4d52-9a42-5a1de577665c req-1166e616-1cb7-4a47-afd1-af3136405557 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.308103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-9ef6bb2b-57f0-4d52-9a42-5a1de577665c req-1166e616-1cb7-4a47-afd1-af3136405557 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.319707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-9ef6bb2b-57f0-4d52-9a42-5a1de577665c req-1166e616-1cb7-4a47-afd1-af3136405557 service nova] Creating event network-vif-plugged:515ef845-da04-4f16-bcd5-2ad3a435334b for instance 606055df-c608-4042-a2f4-c99ccca2367e on hv-cinder-84327 Aug 01 15:29:42.324805 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-9ef6bb2b-57f0-4d52-9a42-5a1de577665c req-1166e616-1cb7-4a47-afd1-af3136405557 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Aug 01 15:29:42.325684 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 610/1225] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:42.987198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:42.987806 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:42.994788 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.995236 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.995994 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.996425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:43.127230 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:43.134535 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ce60a427-5702-443c-8374-59246a5f7e0c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.151267 Aug 01 15:29:43.135131 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 616/1226] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:42 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:44.156987 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:44.157679 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:44.163917 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:44.164366 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:44.165732 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:44.166159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:44.296405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:44.304602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a8f7c6cb-2e85-43c4-b0e5-0e80dcc80ffe tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1263 microversion: 2.1 time: 0.152278 Aug 01 15:29:44.305172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 611/1227] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:44 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:45.326171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:45.326795 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:45.333193 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:45.333636 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:45.334412 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:45.334876 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:45.465977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:45.473362 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e6481844-d876-4d3f-952b-4024140fd931 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1447 microversion: 2.1 time: 0.151307 Aug 01 15:29:45.473923 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 617/1228] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:45 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:45.494432 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:45.495002 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:45.501310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:45.501773 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:45.502518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:45.503007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:45.730857 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:45.738311 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3c8bd82b-fd76-4ffa-a579-fa7ffac25f1a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1447 microversion: 2.1 time: 0.248445 Aug 01 15:29:45.738910 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 612/1229] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:29:45 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1447 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:47.360638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-98005153-32a1-45e2-a0fc-18b40cfb6aad req-47021081-0e16-475a-bc93-02a963ffa5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:47.370518 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-98005153-32a1-45e2-a0fc-18b40cfb6aad req-47021081-0e16-475a-bc93-02a963ffa5ff service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:47.370999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-98005153-32a1-45e2-a0fc-18b40cfb6aad req-47021081-0e16-475a-bc93-02a963ffa5ff service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:47.381801 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-98005153-32a1-45e2-a0fc-18b40cfb6aad req-47021081-0e16-475a-bc93-02a963ffa5ff service nova] Creating event network-changed:515ef845-da04-4f16-bcd5-2ad3a435334b for instance 606055df-c608-4042-a2f4-c99ccca2367e on hv-cinder-84327 Aug 01 15:29:47.386803 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-98005153-32a1-45e2-a0fc-18b40cfb6aad req-47021081-0e16-475a-bc93-02a963ffa5ff service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029808 Aug 01 15:29:47.387386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 618/1230] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:49.853904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:49.854515 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:49.860884 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:49.861330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:49.862087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:49.862525 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:49.885390 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-efbbe496-1d31-4411-bdbb-cbb89839a1e4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/ips" status: 200 len: 149 microversion: 2.1 time: 0.035860 Aug 01 15:29:49.885952 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 613/1231] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:29:49 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:51.207282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f0d4ef-85bf-4285-815c-f7184c0d1b9f"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:51.209719 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:51.216509 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:51.216958 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:51.217720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:51.218157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:51.575837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2b6981c6-9dc1-439e-960b-88bab454263e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372926 Aug 01 15:29:51.576453 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 619/1232] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:29:51 2022] POST /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:59.088129 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f0d4ef-85bf-4285-815c-f7184c0d1b9f"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:59.090445 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:59.093021 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=23 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.098594 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.099115 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.099874 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.100304 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.102906 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=49 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.187135 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Invalid volume: volume d3f0d4ef-85bf-4285-815c-f7184c0d1b9f is already attached to instances: 1c58cce0-c162-41f8-9cbb-eb578485e07b Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments HTTP/1.1 Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 74 Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:29:59.189405 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {"volumeAttachment": {"volumeId": "d3f0d4ef-85bf-4285-815c-f7184c0d1b9f"}} Aug 01 15:29:59.191195 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Invalid volume: volume d3f0d4ef-85bf-4285-815c-f7184c0d1b9f is already attached to instances: 1c58cce0-c162-41f8-9cbb-eb578485e07b Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '1c58cce0-c162-41f8-9cbb-eb578485e07b', 'body': {'volumeAttachment': {'volumeId': 'd3f0d4ef-85bf-4285-815c-f7184c0d1b9f'}}} Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3f0d4ef-85bf-4285-815c-f7184c0d1b9f is already attached to instances: 1c58cce0-c162-41f8-9cbb-eb578485e07b Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:29:59.192097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3f0d4ef-85bf-4285-815c-f7184c0d1b9f is already attached to instances: 1c58cce0-c162-41f8-9cbb-eb578485e07b Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:59.193624 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3f0d4ef-85bf-4285-815c-f7184c0d1b9f is already attached to instances: 1c58cce0-c162-41f8-9cbb-eb578485e07b Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 400 to user: Invalid volume: volume d3f0d4ef-85bf-4285-815c-f7184c0d1b9f is already attached to instances: 1c58cce0-c162-41f8-9cbb-eb578485e07b {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-31ce1679-7130-4641-83fd-4ee18b0e62c9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106805 Aug 01 15:29:59.195333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 614/1233] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:29:59 2022] POST /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:29:59.254036 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:59.254619 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:59.257064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.262500 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.262981 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.263740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.264175 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.268674 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.345373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lazy-loading 'services' on Instance uuid 1c58cce0-c162-41f8-9cbb-eb578485e07b {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:59.418418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-b1be101a-2430-49a1-b9ca-d36293b87b68 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments/d3f0d4ef-85bf-4285-815c-f7184c0d1b9f" status: 202 len: 0 microversion: 2.1 time: 0.168481 Aug 01 15:29:59.419133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 620/1234] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:29:59 2022] DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments/d3f0d4ef-85bf-4285-815c-f7184c0d1b9f => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:29:59.428259 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:59.430596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:59.438346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.438885 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.439771 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.440717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.472925 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-831dc696-6eac-4ed7-b11f-d751dc48a6fb tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049198 Aug 01 15:29:59.473534 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 615/1235] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:29:59 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:00.486749 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:00.489092 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:00.496096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.496540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.497289 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.497720 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.524946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-9df31b74-35cc-4457-a889-0b8f7180c907 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042999 Aug 01 15:30:00.526248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 621/1236] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:30:00 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:30:00.586767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:00.587240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:00.593717 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.594159 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.594947 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.595381 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.620957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:30:00.697545 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-60d846c2-c9fc-403c-addb-5d3fa4090301 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 204 len: 0 microversion: 2.1 time: 0.114348 Aug 01 15:30:00.698127 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 616/1237] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:30:00 2022] DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:30:00.706534 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:00.707161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:00.713546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.713987 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.714760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.715365 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.842479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:00.849984 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2abd040f-e08b-4ba8-b664-8b0ab0e8dc5d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1684 microversion: 2.1 time: 0.147338 Aug 01 15:30:00.850546 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 622/1238] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:00 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:01.872721 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:01.873424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:01.879904 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:01.880351 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:01.881105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:01.881545 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:02.011995 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:02.019514 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-101a9086-49df-4e21-b202-6601796c691c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1684 microversion: 2.1 time: 0.151619 Aug 01 15:30:02.020074 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 617/1239] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:01 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:03.040487 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:03.041100 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:03.047729 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:03.048177 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:03.048936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:03.049377 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:03.280061 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:03.287404 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-48619bc5-98f2-454a-a8c8-18d3802cefa6 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1684 microversion: 2.1 time: 0.250760 Aug 01 15:30:03.287976 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 623/1240] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:03 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1684 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:03.838889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d92ce7f5-396d-4c83-8762-7c33bc783e2a req-891d7b1a-3c57-4377-9c91-29a14c0e6085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58cce0-c162-41f8-9cbb-eb578485e07b", "name": "network-vif-deleted", "tag": "89c6f5a9-cd74-4c97-ae0b-caa7878a8e08"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:03.849751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d92ce7f5-396d-4c83-8762-7c33bc783e2a req-891d7b1a-3c57-4377-9c91-29a14c0e6085 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:03.850297 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d92ce7f5-396d-4c83-8762-7c33bc783e2a req-891d7b1a-3c57-4377-9c91-29a14c0e6085 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:03.862643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d92ce7f5-396d-4c83-8762-7c33bc783e2a req-891d7b1a-3c57-4377-9c91-29a14c0e6085 service nova] Creating event network-vif-deleted:89c6f5a9-cd74-4c97-ae0b-caa7878a8e08 for instance 1c58cce0-c162-41f8-9cbb-eb578485e07b on hv-cinder-84327 Aug 01 15:30:03.868587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d92ce7f5-396d-4c83-8762-7c33bc783e2a req-891d7b1a-3c57-4377-9c91-29a14c0e6085 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033797 Aug 01 15:30:03.869736 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 618/1241] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:04.310132 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:04.312027 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:04.318590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:04.319068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:04.319845 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:04.320282 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:04.357271 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:04.357880 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:04.358272 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lazy-loading 'fault' on Instance uuid 1c58cce0-c162-41f8-9cbb-eb578485e07b {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:30:04.405736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:04.414848 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-87e52fce-d1d1-49b8-b555-b67dacd81754 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 200 len: 1334 microversion: 2.1 time: 0.108645 Aug 01 15:30:04.415672 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 624/1242] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:04 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:05.438149 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:05.438889 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:05.445220 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:05.445670 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:05.446430 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:05.446988 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:05.460758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b HTTP/1.1 Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:30:05.462355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:30:05.464018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '1c58cce0-c162-41f8-9cbb-eb578485e07b'} Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:30:05.465024 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:30:05.466334 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:30:05.467664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:30:05.467664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3134b27d-5ecb-489b-8653-32210c1c9f2c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 404 len: 111 microversion: 2.1 time: 0.030481 Aug 01 15:30:05.467664 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 619/1243] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:05 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:30:05.472829 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-526412a6-ccd9-4992-af33-bb33cd452fc7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '.version_select at 0x7efd1d19a4c0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:05.492249 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-526412a6-ccd9-4992-af33-bb33cd452fc7 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640828723" status: 202 len: 0 microversion: 2.1 time: 0.023224 Aug 01 15:30:05.492818 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 625/1244] 10.222.0.100 () {58 vars in 1223 bytes} [Mon Aug 1 15:30:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640828723 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:30:06.091905 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f85164e-1b81-4e47-82ff-f3c1461d8c34 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: .version_select at 0x7efd1d3ce1f0>, body: {"keypair": {"name": "tempest-keypair-658165696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiY2Ej+KGD2V9ATYXhqkjvSarUD4lsp/s9zjLZssWH2PvLHRsAUZvZtfrNd2b/IO9v0W8I/ZFDWgTkqBfya6ByxvH8sQjb47pUZ7wGGsOT6vojBrgcKcp2lTI69+WwaGg=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:06.106694 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-3f85164e-1b81-4e47-82ff-f3c1461d8c34 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:30:06.110496 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-3f85164e-1b81-4e47-82ff-f3c1461d8c34 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:30:06.132123 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f85164e-1b81-4e47-82ff-f3c1461d8c34 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044016 Aug 01 15:30:06.136825 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 620/1245] 10.222.0.100 () {60 vars in 1164 bytes} [Mon Aug 1 15:30:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:07.619886 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1779599731", "imageRef": "bbf92943-ed00-41db-a972-e38610f109d0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64714ec3-4fee-42c0-bc82-5b770c41babf"}], "security_groups": [{"name": "tempest-securitygroup--947544991"}], "key_name": "tempest-keypair-658165696", "user_data": "}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:07.727418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.network.neutron [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] validate_networks() for [('64714ec3-4fee-42c0-bc82-5b770c41babf', None, None, None, None, None)] {{(pid=117887) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:30:08.102144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:30:08.102567 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image limits 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:30:08.103075 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Flavor pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:30:08.103482 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Image pref 0:0:0 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:30:08.103891 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.virt.hardware [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:30:08.113491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:08.113933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:08.114760 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:08.115196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:08.134466 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:30:08.139046 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.quota [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Getting quotas for user 49f98078ac424b1284932839be652265 and project 89ef702cd1114e3eac72ff64e2d80b1c. Resources: {'ram', 'cores', 'instances'} {{(pid=117887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:30:08.149898 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Going to run 1 instances... {{(pid=117887) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:30:08.152169 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf92943-ed00-41db-a972-e38610f109d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:30:08.198414 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-3daac09e-1475-406c-8f87-012ea333d635 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.583949 Aug 01 15:30:08.199089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 626/1246] 10.222.0.100 () {60 vars in 1152 bytes} [Mon Aug 1 15:30:07 2022] POST /compute/v2.1/servers => generated 403 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 01 15:30:08.210005 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f170153-d5ab-4b51-907c-0a0a75f703b0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:08.210604 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f170153-d5ab-4b51-907c-0a0a75f703b0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:08.265979 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f170153-d5ab-4b51-907c-0a0a75f703b0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:08.272648 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f170153-d5ab-4b51-907c-0a0a75f703b0 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1245 microversion: 2.1 time: 0.066485 Aug 01 15:30:08.273201 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 621/1247] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:08 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:09.294924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:09.295543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:09.303217 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:09.303750 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:09.304668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:09.305144 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:09.615060 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:09.623234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-04e1719d-e441-4252-b9ad-0e6ab14b7069 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1303 microversion: 2.1 time: 0.333675 Aug 01 15:30:09.623791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 627/1248] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:09 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1303 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:10.644310 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:10.645056 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:10.652278 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:10.652805 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:10.653641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:10.654173 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:10.855472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-d3b7559f-9d2b-4e27-b8a8-7e72a3062f54 req-330e2d57-efa5-4db8-94cf-4cf0e86fcf1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4d8e8b-7d30-4d38-8bdf-a75c2f460365", "tag": "b5adaa05-01eb-42db-8d46-8685263a1145"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:10.863099 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:10.873002 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d3b7559f-9d2b-4e27-b8a8-7e72a3062f54 req-330e2d57-efa5-4db8-94cf-4cf0e86fcf1a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:10.873499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d3b7559f-9d2b-4e27-b8a8-7e72a3062f54 req-330e2d57-efa5-4db8-94cf-4cf0e86fcf1a service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:10.878798 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-25ce7928-517b-43ba-b5c7-484371566ae4 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.238268 Aug 01 15:30:10.879585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 622/1249] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:10 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:10.884937 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-d3b7559f-9d2b-4e27-b8a8-7e72a3062f54 req-330e2d57-efa5-4db8-94cf-4cf0e86fcf1a service nova] Creating event network-changed:b5adaa05-01eb-42db-8d46-8685263a1145 for instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 on hv-cinder-84327 Aug 01 15:30:10.889956 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-d3b7559f-9d2b-4e27-b8a8-7e72a3062f54 req-330e2d57-efa5-4db8-94cf-4cf0e86fcf1a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038960 Aug 01 15:30:10.890924 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 628/1250] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:30:11.899490 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:11.900141 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:11.907145 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:11.907593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:11.908353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:11.908789 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:12.034305 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:12.042230 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c6e9d253-8f08-4a88-94ab-bd2d36c63c14 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.146557 Aug 01 15:30:12.042818 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 623/1251] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:11 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:13.064418 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:13.065119 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:13.071407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:13.071860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:13.073154 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:13.073745 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:13.204382 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:13.211904 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-7417183f-3ba1-428d-8a72-7dd1b0977392 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.152265 Aug 01 15:30:13.212471 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 629/1252] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:13 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:14.233948 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:14.234564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:14.241103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:14.241559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:14.242322 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:14.242796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:14.376519 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:14.384824 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fac9f8aa-0904-4d42-b1bd-484beabb8b76 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.154742 Aug 01 15:30:14.385585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 624/1253] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:14 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:15.407325 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:15.407931 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:15.414373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:15.414853 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:15.415619 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:15.417444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:15.542437 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:15.550070 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-8d8c09c7-7a6f-4ea4-a507-de0656b57d9b tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.146610 Aug 01 15:30:15.550638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 630/1254] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:15 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:16.570607 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:16.573213 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:16.582586 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:16.583912 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:16.584750 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:16.585802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:16.595458 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-9ccb9100-0e83-4267-9864-0ee76534570b req-c9007242-823c-4a6f-85fd-49730b47501f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4d8e8b-7d30-4d38-8bdf-a75c2f460365", "name": "network-vif-plugged", "status": "completed", "tag": "b5adaa05-01eb-42db-8d46-8685263a1145"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:16.609336 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-9ccb9100-0e83-4267-9864-0ee76534570b req-c9007242-823c-4a6f-85fd-49730b47501f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:16.610109 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-9ccb9100-0e83-4267-9864-0ee76534570b req-c9007242-823c-4a6f-85fd-49730b47501f service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:16.623952 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-9ccb9100-0e83-4267-9864-0ee76534570b req-c9007242-823c-4a6f-85fd-49730b47501f service nova] Creating event network-vif-plugged:b5adaa05-01eb-42db-8d46-8685263a1145 for instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 on hv-cinder-84327 Aug 01 15:30:16.630067 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-9ccb9100-0e83-4267-9864-0ee76534570b req-c9007242-823c-4a6f-85fd-49730b47501f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038859 Aug 01 15:30:16.631157 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 631/1255] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:16.762638 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:16.768631 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f685ca95-cbd4-400c-93ed-c5460773af6e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.201904 Aug 01 15:30:16.769518 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 625/1256] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:16 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:17.790508 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:17.791256 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:17.798928 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:17.799378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:17.800142 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:17.800575 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:17.954804 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:17.962173 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-18ef0f6f-b55d-4700-8c47-6e8f6c5def0e tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1370 microversion: 2.1 time: 0.176431 Aug 01 15:30:17.962752 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 632/1257] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:17 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:18.983884 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:18.984422 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:18.986823 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:18.992424 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:18.992864 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:18.993611 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:18.994111 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:19.122097 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:19.129596 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1572ef2f-1cf8-4a49-b16a-968ffb619d6d tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1560 microversion: 2.1 time: 0.149662 Aug 01 15:30:19.130154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 626/1258] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:30:18 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:19.152268 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:19.152811 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:19.154754 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:19.155434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell0:SELECT=6 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:19.161841 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:19.162292 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:19.163112 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:19.163558 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:19.239629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f30f72ca-1a69-43c5-992a-b364723454ac tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091416 Aug 01 15:30:19.240226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 633/1259] 10.222.0.100 () {58 vars in 1280 bytes} [Mon Aug 1 15:30:19 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:20.167007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a53efa91-6d91-49a6-8b56-73d35f8eb482 req-dfc04bf3-e86b-4af4-ab78-100beaeb2764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4d8e8b-7d30-4d38-8bdf-a75c2f460365", "tag": "b5adaa05-01eb-42db-8d46-8685263a1145"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:20.176647 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a53efa91-6d91-49a6-8b56-73d35f8eb482 req-dfc04bf3-e86b-4af4-ab78-100beaeb2764 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:20.177094 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a53efa91-6d91-49a6-8b56-73d35f8eb482 req-dfc04bf3-e86b-4af4-ab78-100beaeb2764 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:20.188551 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a53efa91-6d91-49a6-8b56-73d35f8eb482 req-dfc04bf3-e86b-4af4-ab78-100beaeb2764 service nova] Creating event network-changed:b5adaa05-01eb-42db-8d46-8685263a1145 for instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 on hv-cinder-84327 Aug 01 15:30:20.193555 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a53efa91-6d91-49a6-8b56-73d35f8eb482 req-dfc04bf3-e86b-4af4-ab78-100beaeb2764 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030791 Aug 01 15:30:20.194358 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 627/1260] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:25.658815 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:31:25.659435 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:31:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:31:36.384904 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:36.385751 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:36.389919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:36.390424 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:36.398540 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:36.399006 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:36.399758 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:36.400209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:36.428037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ce3501e9-d4f8-44df-9ece-d61e1743dd01 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/ips" status: 200 len: 150 microversion: 2.1 time: 0.045104 Aug 01 15:31:36.428607 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 634/1261] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:31:36 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:37.760675 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:37.761507 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:37.767105 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67c87642-7c1d-4026-92c1-225c55be7c56"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:37.769538 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:37.778963 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.779413 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.780178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.780619 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.084337 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-138c684f-b0d1-4cbe-b4f8-97750f8a6569 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "POST /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325766 Aug 01 15:31:38.084930 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 628/1262] 10.222.0.100 () {60 vars in 1328 bytes} [Mon Aug 1 15:31:37 2022] POST /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:45.715392 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:45.715916 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:45.722257 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:45.722742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:45.723501 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:45.723932 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:45.802719 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lazy-loading 'services' on Instance uuid 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:31:45.874329 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-e4fbc82f-eee5-4da9-a588-736c97c73da2 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments/67c87642-7c1d-4026-92c1-225c55be7c56" status: 202 len: 0 microversion: 2.1 time: 0.162700 Aug 01 15:31:45.874946 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 635/1263] 10.222.0.100 () {58 vars in 1421 bytes} [Mon Aug 1 15:31:45 2022] DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments/67c87642-7c1d-4026-92c1-225c55be7c56 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:31:45.884842 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:45.887196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:45.893804 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:45.894251 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:45.895054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:45.895487 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:45.928599 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8c5e6dbe-2c21-4aa5-aa6d-287db6d978cd tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049107 Aug 01 15:31:45.929155 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 629/1264] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:31:45 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:46.942064 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:46.944407 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:46.952647 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:46.953034 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:46.953800 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:46.954234 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:46.983262 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c970351e-5b33-4991-a8b3-eb793b198b75 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045604 Aug 01 15:31:46.983822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 636/1265] 10.222.0.100 () {58 vars in 1307 bytes} [Mon Aug 1 15:31:46 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:31:47.044107 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:47.045093 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:47.051505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.051944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.052693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.053117 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.078128 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:31:47.149758 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-34ff8545-eea3-429c-8faa-a0e7fcadae54 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 204 len: 0 microversion: 2.1 time: 0.109203 Aug 01 15:31:47.150420 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 630/1266] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:31:47 2022] DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:31:47.159041 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:47.159664 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:47.165623 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.166072 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.166855 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.167290 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.298629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:47.306264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a98e9537-9598-4893-81bd-f05ff90ed071 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1685 microversion: 2.1 time: 0.151042 Aug 01 15:31:47.306871 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 637/1267] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:47 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:31:48.329765 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:48.330505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:48.337353 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:48.337798 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:48.338576 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:48.339046 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:48.475540 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:48.483735 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-81ae4890-72e0-4ffb-a3eb-033bb819c422 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1685 microversion: 2.1 time: 0.159040 Aug 01 15:31:48.484309 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 631/1268] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:48 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:49.504643 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:49.505386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:49.512736 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:49.513689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:49.514472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:49.514933 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:49.774324 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:49.782096 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-dae90b50-b0ed-4ff2-8756-c234e90cc120 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1685 microversion: 2.1 time: 0.281482 Aug 01 15:31:49.782676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 638/1269] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:49 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1685 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:50.400937 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-44237b61-527b-4184-8bd6-3ad2019ff862 req-6dd6475a-0d04-419b-ac94-c0d3ada9e338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4d8e8b-7d30-4d38-8bdf-a75c2f460365", "name": "network-vif-deleted", "tag": "b5adaa05-01eb-42db-8d46-8685263a1145"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:50.414194 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-44237b61-527b-4184-8bd6-3ad2019ff862 req-6dd6475a-0d04-419b-ac94-c0d3ada9e338 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:50.414851 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-44237b61-527b-4184-8bd6-3ad2019ff862 req-6dd6475a-0d04-419b-ac94-c0d3ada9e338 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.429340 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-44237b61-527b-4184-8bd6-3ad2019ff862 req-6dd6475a-0d04-419b-ac94-c0d3ada9e338 service nova] Creating event network-vif-deleted:b5adaa05-01eb-42db-8d46-8685263a1145 for instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 on hv-cinder-84327 Aug 01 15:31:50.435524 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-44237b61-527b-4184-8bd6-3ad2019ff862 req-6dd6475a-0d04-419b-ac94-c0d3ada9e338 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149369 Aug 01 15:31:50.436482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 632/1270] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:50.803822 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:50.805251 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:50.817483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:50.818121 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.818934 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:50.819366 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.860716 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:50.861172 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.861628 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lazy-loading 'fault' on Instance uuid 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:31:50.908997 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f98078ac424b1284932839be652265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef702cd1114e3eac72ff64e2d80b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:50.915940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-49f1bf2a-6243-4665-aef5-2b338df57a62 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 200 len: 1335 microversion: 2.1 time: 0.116282 Aug 01 15:31:50.916520 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 639/1271] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:50 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:51.938408 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:51.939273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:51.946253 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:51.946821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:51.947640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:51.948087 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:51.962168 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 HTTP/1.1 Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:31:51.963846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:51.967043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '1a4d8e8b-7d30-4d38-8bdf-a75c2f460365'} Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:51.968821 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:51.971772 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:51.974041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:51.974041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ccefae81-a304-4883-bc0c-29d0b13fc66c tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 404 len: 111 microversion: 2.1 time: 0.031380 Aug 01 15:31:51.974041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 633/1272] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:51 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:51.976448 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-550e1c00-d1e8-4f5e-a85f-b731130cce17 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '.version_select at 0x7efd1cbd3790>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:51.997977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-550e1c00-d1e8-4f5e-a85f-b731130cce17 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-658165696" status: 202 len: 0 microversion: 2.1 time: 0.025042 Aug 01 15:31:51.999099 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 640/1273] 10.222.0.100 () {58 vars in 1223 bytes} [Mon Aug 1 15:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-658165696 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:31:53.777707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:53.778207 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:53.785339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:53.785791 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:53.786556 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:53.787103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:53.801451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 HTTP/1.1 Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:31:53.802958 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.804522 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '1a4d8e8b-7d30-4d38-8bdf-a75c2f460365'} Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:53.805406 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.807312 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.809707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:53.809707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05b02412-5e26-4c9e-a65c-56c3b41274e8 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 404 len: 111 microversion: 2.1 time: 0.030927 Aug 01 15:31:53.809707 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 634/1274] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:31:53 2022] DELETE /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:53.814017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:53.814618 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:53.821198 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:53.821677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:53.822425 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:53.822883 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:53.836408 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 HTTP/1.1 Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:31:53.838059 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.839732 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '1a4d8e8b-7d30-4d38-8bdf-a75c2f460365'} Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:53.840684 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. Aug 01 15:31:53.842895 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:53.844302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:53.844302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f0e56785-b23e-4318-93aa-580a19c3bdb1 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365" status: 404 len: 111 microversion: 2.1 time: 0.029933 Aug 01 15:31:53.844302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 641/1275] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:53 2022] GET /compute/v2.1/servers/1a4d8e8b-7d30-4d38-8bdf-a75c2f460365 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:54.977054 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:54.977583 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:54.985617 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:54.986071 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:54.986913 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:54.987383 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.001593 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b HTTP/1.1 Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:31:55.003184 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.004830 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '1c58cce0-c162-41f8-9cbb-eb578485e07b'} Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:55.005860 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.007816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.009326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:55.009326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1e16d41-3cee-4d79-9e7a-9b3f942864c5 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 404 len: 111 microversion: 2.1 time: 0.031404 Aug 01 15:31:55.009326 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 635/1276] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:31:54 2022] DELETE /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:31:55.014586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:55.015216 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 1c58cce0-c162-41f8-9cbb-eb578485e07b] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:55.021674 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:55.022124 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.022911 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:55.023349 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.039118 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b HTTP/1.1 Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:31:55.040641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.042275 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '1c58cce0-c162-41f8-9cbb-eb578485e07b'} Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:55.043241 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. Aug 01 15:31:55.044837 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.046894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 1c58cce0-c162-41f8-9cbb-eb578485e07b could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:55.046894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f102f9f1-5f2a-4025-a8a2-e1c29a106f22 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b" status: 404 len: 111 microversion: 2.1 time: 0.031438 Aug 01 15:31:55.046894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 642/1277] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:55 2022] GET /compute/v2.1/servers/1c58cce0-c162-41f8-9cbb-eb578485e07b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:55.051063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:55.051587 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:55.057578 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:55.058025 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.058819 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:55.059256 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.072196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 HTTP/1.1 Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:31:55.073708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.075699 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '604aa977-4208-40a5-aac6-5b476fa47320'} Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:55.076814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.078482 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.080120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:55.080120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-baac1f6c-9c85-4822-ba7d-760425d05cc9 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 404 len: 111 microversion: 2.1 time: 0.028168 Aug 01 15:31:55.080120 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 636/1278] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:31:55 2022] DELETE /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:55.083679 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:55.084235 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 604aa977-4208-40a5-aac6-5b476fa47320] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:55.090226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:55.090693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.091475 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:55.091913 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:55.105816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 HTTP/1.1 Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:31:55.107359 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.109443 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '604aa977-4208-40a5-aac6-5b476fa47320'} Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:55.110373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. Aug 01 15:31:55.112029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:55.113420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 604aa977-4208-40a5-aac6-5b476fa47320 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:55.113420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-fdec41ca-5123-4511-8df2-fd80b0331164 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320" status: 404 len: 111 microversion: 2.1 time: 0.029473 Aug 01 15:31:55.113420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 643/1279] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:55 2022] GET /compute/v2.1/servers/604aa977-4208-40a5-aac6-5b476fa47320 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:56.258745 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:56.259277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:56.265780 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:56.266229 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:56.267058 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:56.267511 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:56.280922 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 HTTP/1.1 Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:31:56.282481 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: > Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.284269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '50fe1da9-6f4b-4843-ab47-523d01773f03'} Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:56.285089 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.286564 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.288409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:56.288409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c072a1af-6b71-4bb7-8f91-693b52616983 tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 404 len: 111 microversion: 2.1 time: 0.029051 Aug 01 15:31:56.288409 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 637/1280] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:31:56 2022] DELETE /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:56.292419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:56.293029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] [instance: 50fe1da9-6f4b-4843-ab47-523d01773f03] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:56.300215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:56.300666 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:56.301438 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:56.301870 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:56.316378 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] HTTP exception thrown: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Request method failure captured: Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 HTTP/1.1 Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5-_igTKJVC5zYfvW-AF_5bbx988Xww1l-zU6iom2rgrIhqTAGA3q7YyGCT8qWDShXBxLf30YRavhobpCTFHSd5eny__Z9OLvsOzURJ4x7i-TMXC8MLzNcehiOqBA1VjMg8T5TDITj4V24qefFMscPWRNvhUoMwHddpW6Z2kcp4XIYew Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:31:56.317951 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_89ef702cd1114e3eac72ff64e2d80b1c", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/89ef702cd1114e3eac72ff64e2d80b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 89ef702cd1114e3eac72ff64e2d80b1c Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-609467836 Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 49f98078ac424b1284932839be652265 Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-AttachVolumeNegativeTest-609467836-project Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.319656 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '50fe1da9-6f4b-4843-ab47-523d01773f03'} Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:56.320614 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. Aug 01 15:31:56.322029 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:31:56.323226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] Returning 404 to user: Instance 50fe1da9-6f4b-4843-ab47-523d01773f03 could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:56.323226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-092455c1-1557-43ec-b95d-7f834165f03f tempest-AttachVolumeNegativeTest-609467836 tempest-AttachVolumeNegativeTest-609467836-project] 10.222.0.100 "GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03" status: 404 len: 111 microversion: 2.1 time: 0.030843 Aug 01 15:31:56.323226 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 644/1281] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:31:56 2022] GET /compute/v2.1/servers/50fe1da9-6f4b-4843-ab47-523d01773f03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:32:00.675277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2194485f-cfec-4b8e-be19-ee001166f585 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Action: 'create', calling method: .version_select at 0x7efd1d35a0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1553400591"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:00.974144 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2194485f-cfec-4b8e-be19-ee001166f585 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.411512 Aug 01 15:32:00.975036 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 638/1282] 10.222.0.100 () {60 vars in 1160 bytes} [Mon Aug 1 15:32:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 413 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 01 15:32:00.987926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-c1c9b8d9-dd97-4673-8637-f6fa684977c3 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd218583a0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:01.041432 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-c1c9b8d9-dd97-4673-8637-f6fa684977c3 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 200 len: 345 microversion: 2.1 time: 0.057390 Aug 01 15:32:01.042038 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 645/1283] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:32:00 2022] GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:02.055663 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2465e9e7-f5ed-4528-854e-7f93ebc70c50 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d001b80>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:02.106339 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2465e9e7-f5ed-4528-854e-7f93ebc70c50 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 200 len: 346 microversion: 2.1 time: 0.054944 Aug 01 15:32:02.106977 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 639/1284] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:32:02 2022] GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:02.120151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a65aefc3-5f04-4852-961b-37706c4ec5f6 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Action: 'create', calling method: .version_select at 0x7efd1dad5a60>, body: {"snapshot": {"volume_id": "5c5cf714-e52b-433a-a547-09d602c06a5d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1450983448"}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:02.273420 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a65aefc3-5f04-4852-961b-37706c4ec5f6 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.157425 Aug 01 15:32:02.274824 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 646/1285] 10.222.0.100 () {60 vars in 1167 bytes} [Mon Aug 1 15:32:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:02.285841 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6610934c-33f4-4e3b-8949-3f33d4c26d05 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d0014c0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:02.320633 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6610934c-33f4-4e3b-8949-3f33d4c26d05 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 287 microversion: 2.1 time: 0.038972 Aug 01 15:32:02.321250 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 640/1286] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:02 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:02.332537 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5167b48a-7b0d-402b-be19-18475b0c1b6f tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1cc6ba60>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:02.364810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5167b48a-7b0d-402b-be19-18475b0c1b6f tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035959 Aug 01 15:32:02.365371 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 647/1287] 10.222.0.100 () {58 vars in 1145 bytes} [Mon Aug 1 15:32:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:02.376323 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4491b8e3-602e-4d78-b02e-d0c9da3cfb79 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d5bf820>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:02.406852 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4491b8e3-602e-4d78-b02e-d0c9da3cfb79 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 287 microversion: 2.1 time: 0.034235 Aug 01 15:32:02.407416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 641/1288] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:02 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:03.420417 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-65060c86-166a-4815-8720-ab93e6e8a59a tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d1a9430>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:03.450620 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-65060c86-166a-4815-8720-ab93e6e8a59a tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 287 microversion: 2.1 time: 0.034519 Aug 01 15:32:03.451223 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 648/1289] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:03 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:04.463984 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2aca0ad4-faf4-4e13-ae91-8ebecebe402e tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d2bbb80>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:04.494809 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2aca0ad4-faf4-4e13-ae91-8ebecebe402e tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 287 microversion: 2.1 time: 0.034951 Aug 01 15:32:04.495373 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 642/1290] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:04 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:05.417102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:05.417717 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:05.425023 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:05.425488 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:05.426248 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:05.426708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:05.448457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.objects.instance [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lazy-loading 'flavor' on Instance uuid 606055df-c608-4042-a2f4-c99ccca2367e {{(pid=117887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:32:05.508028 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ede40443-8de8-41b2-8dc3-7230d3a66e80 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d391a60>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:05.520689 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-97c17cda-9f07-43e7-84d9-933a1df7dd3a tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "POST /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e/action" status: 202 len: 0 microversion: 2.1 time: 0.107851 Aug 01 15:32:05.521455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 649/1291] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:32:05 2022] POST /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:32:05.530613 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:05.531617 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:05.538221 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:05.538690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:05.539483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:05.540348 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:05.548899 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ede40443-8de8-41b2-8dc3-7230d3a66e80 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 287 microversion: 2.1 time: 0.045503 Aug 01 15:32:05.549559 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 643/1292] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:05 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:32:05.680667 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:05.688312 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-66269b2d-7253-4947-988b-adf1795b85d4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.162363 Aug 01 15:32:05.688876 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 650/1293] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:05 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:06.558881 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:06.559643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:06.564703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-770ce5fb-e30e-4963-8d21-657fbc2b78da tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d2bb040>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:06.597453 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-770ce5fb-e30e-4963-8d21-657fbc2b78da tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 288 microversion: 2.1 time: 0.039285 Aug 01 15:32:06.598009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 644/1294] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:06 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:06.609645 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-95d4ae37-e7d3-4790-8825-6e20a80fe412 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd21a0b5e0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:06.668779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-95d4ae37-e7d3-4790-8825-6e20a80fe412 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "DELETE /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 202 len: 0 microversion: 2.1 time: 0.062830 Aug 01 15:32:06.668779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 651/1295] 10.222.0.100 () {58 vars in 1259 bytes} [Mon Aug 1 15:32:06 2022] DELETE /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:32:06.677448 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fb65d1ac-cc23-4518-b65f-ffa26e0d54e0 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d0b85e0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:06.707498 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fb65d1ac-cc23-4518-b65f-ffa26e0d54e0 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 200 len: 287 microversion: 2.1 time: 0.033854 Aug 01 15:32:06.708154 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 645/1296] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:06 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:06.709335 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:06.709940 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:06.711927 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:06.717977 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:06.718417 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:06.719199 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:06.719629 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:06.723193 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:06.851660 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:06.859903 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-ccfbc72c-6d3a-4515-8976-7353811391cc tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.154357 Aug 01 15:32:06.860462 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 652/1297] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:06 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:07.720749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f1e008fb-178c-4188-a966-9ccb572ffa61 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d391b80>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:07.746371 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-f1e008fb-178c-4188-a966-9ccb572ffa61 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] HTTP exception thrown: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f1e008fb-178c-4188-a966-9ccb572ffa61 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Request method failure captured: Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 HTTP/1.1 Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5_HwsLCqRPSlY9oDvmPBjx_Ccvq-vsHyfekUN5oyEmCzQF-Q7ra3C-6obecBnPah5DFPX_Vovvn_eUzm1CwE-9NI1FRSzRT9W4MVJhO0kSEABRvd55ufFizE5TwfsKbJYTm_UtXRbvYEUACHJ0aFk9zD-Jf-0qX1bNbCgr7YMpPDhEQ Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:32:07.749763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b3461561695b4e81aaa6628882c626fd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: b7e1cc400a3a4e56901290597d6a7c55 Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '3a2508f5-34c5-4ace-b064-72a8d4f60cd5'} Aug 01 15:32:07.751629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. (HTTP 404) (Request-ID: req-68177c3e-c956-43c0-9e19-6871328eb43a) Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.752723 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:32:07.754277 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 15:32:07.756102 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f1e008fb-178c-4188-a966-9ccb572ffa61 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Returning 404 to user: Snapshot 3a2508f5-34c5-4ace-b064-72a8d4f60cd5 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:32:07.757934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f1e008fb-178c-4188-a966-9ccb572ffa61 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5" status: 404 len: 111 microversion: 2.1 time: 0.035328 Aug 01 15:32:07.759055 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 646/1298] 10.222.0.100 () {58 vars in 1256 bytes} [Mon Aug 1 15:32:07 2022] GET /compute/v2.1/os-snapshots/3a2508f5-34c5-4ace-b064-72a8d4f60cd5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:32:07.760409 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2efae975-f1ba-4c0c-b0e0-050553c71385 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd21a0b430>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:07.822861 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2efae975-f1ba-4c0c-b0e0-050553c71385 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 202 len: 0 microversion: 2.1 time: 0.066456 Aug 01 15:32:07.823459 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 653/1299] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:32:07 2022] DELETE /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:32:07.831911 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8d7a52d4-2c19-476c-adb7-27f070bad3b7 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d391040>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:07.880320 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8d7a52d4-2c19-476c-adb7-27f070bad3b7 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 200 len: 345 microversion: 2.1 time: 0.052157 Aug 01 15:32:07.880816 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:07.881431 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:07.886244 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 647/1300] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:32:07 2022] GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:07.888003 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:07.888455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:07.889228 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:07.889665 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:08.036125 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:08.043902 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-46986ae5-ee71-44f8-ae32-45cebe529a8c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.167040 Aug 01 15:32:08.044483 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 654/1301] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:07 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:08.894055 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ff262ed-14db-49e2-a181-3af8ef56a61d tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1e6cf790>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:08.924505 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-9ff262ed-14db-49e2-a181-3af8ef56a61d tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] HTTP exception thrown: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ff262ed-14db-49e2-a181-3af8ef56a61d tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Request method failure captured: Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d HTTP/1.1 Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5_HwsLCqRPSlY9oDvmPBjx_Ccvq-vsHyfekUN5oyEmCzQF-Q7ra3C-6obecBnPah5DFPX_Vovvn_eUzm1CwE-9NI1FRSzRT9W4MVJhO0kSEABRvd55ufFizE5TwfsKbJYTm_UtXRbvYEUACHJ0aFk9zD-Jf-0qX1bNbCgr7YMpPDhEQ Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:32:08.928468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b3461561695b4e81aaa6628882c626fd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: b7e1cc400a3a4e56901290597d6a7c55 Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '5c5cf714-e52b-433a-a547-09d602c06a5d'} Aug 01 15:32:08.930234 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. (HTTP 404) (Request-ID: req-926cd12e-d49b-46fe-9ea3-e1c75c18e5e1) Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:08.931378 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:32:08.933218 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:32:08.935749 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ff262ed-14db-49e2-a181-3af8ef56a61d tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Returning 404 to user: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ff262ed-14db-49e2-a181-3af8ef56a61d tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 404 len: 109 microversion: 2.1 time: 0.040827 Aug 01 15:32:08.938175 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 648/1302] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:32:08 2022] GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:32:08.946246 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-eba47d0f-d52a-414a-8376-082fa26e2914 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1cc7edc0>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:08.978171 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-eba47d0f-d52a-414a-8376-082fa26e2914 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] HTTP exception thrown: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-eba47d0f-d52a-414a-8376-082fa26e2914 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Request method failure captured: Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: DELETE /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d HTTP/1.1 Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5_HwsLCqRPSlY9oDvmPBjx_Ccvq-vsHyfekUN5oyEmCzQF-Q7ra3C-6obecBnPah5DFPX_Vovvn_eUzm1CwE-9NI1FRSzRT9W4MVJhO0kSEABRvd55ufFizE5TwfsKbJYTm_UtXRbvYEUACHJ0aFk9zD-Jf-0qX1bNbCgr7YMpPDhEQ Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:32:08.980634 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b3461561695b4e81aaa6628882c626fd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: b7e1cc400a3a4e56901290597d6a7c55 Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '5c5cf714-e52b-433a-a547-09d602c06a5d'} Aug 01 15:32:08.982427 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. (HTTP 404) (Request-ID: req-9d891c33-b86a-4bf2-bcbe-2eabe934cb0a) Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:08.984161 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:32:08.985724 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:32:08.987337 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-eba47d0f-d52a-414a-8376-082fa26e2914 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Returning 404 to user: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:32:08.988872 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-eba47d0f-d52a-414a-8376-082fa26e2914 tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 404 len: 109 microversion: 2.1 time: 0.039615 Aug 01 15:32:08.989901 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 655/1303] 10.222.0.100 () {58 vars in 1253 bytes} [Mon Aug 1 15:32:08 2022] DELETE /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:32:08.999888 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-99654806-df85-4535-b2c5-d26d2eb7601b tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Calling method '.version_select at 0x7efd1d391040>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:09.027333 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-99654806-df85-4535-b2c5-d26d2eb7601b tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] HTTP exception thrown: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-99654806-df85-4535-b2c5-d26d2eb7601b tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Request method failure captured: Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d HTTP/1.1 Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept: application/json Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Connection: close Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Length: 0 Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Content-Type: application/json Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Host: 10.222.0.100 Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5_HwsLCqRPSlY9oDvmPBjx_Ccvq-vsHyfekUN5oyEmCzQF-Q7ra3C-6obecBnPah5DFPX_Vovvn_eUzm1CwE-9NI1FRSzRT9W4MVJhO0kSEABRvd55ufFizE5TwfsKbJYTm_UtXRbvYEUACHJ0aFk9zD-Jf-0qX1bNbCgr7YMpPDhEQ Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Role: member,reader Aug 01 15:32:09.029269 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_b3461561695b4e81aaa6628882c626fd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/b3461561695b4e81aaa6628882c626fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Id: b3461561695b4e81aaa6628882c626fd Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1205479435 Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Id: b7e1cc400a3a4e56901290597d6a7c55 Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1205479435-project Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: method: Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: exception: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: action_args: {'id': '5c5cf714-e52b-433a-a547-09d602c06a5d'} Aug 01 15:32:09.031142 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. (HTTP 404) (Request-ID: req-99ec52cd-49eb-47be-820b-e5619fcaa22e) Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:09.032419 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:32:09.033903 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:32:09.035609 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-99654806-df85-4535-b2c5-d26d2eb7601b tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] Returning 404 to user: Volume 5c5cf714-e52b-433a-a547-09d602c06a5d could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-99654806-df85-4535-b2c5-d26d2eb7601b tempest-VolumesSnapshotsTestJSON-1205479435 tempest-VolumesSnapshotsTestJSON-1205479435-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d" status: 404 len: 109 microversion: 2.1 time: 0.043323 Aug 01 15:32:09.037557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 649/1304] 10.222.0.100 () {58 vars in 1250 bytes} [Mon Aug 1 15:32:08 2022] GET /compute/v2.1/os-volumes/5c5cf714-e52b-433a-a547-09d602c06a5d => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:32:09.069097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:09.069714 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:09.077147 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:09.077609 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:09.078397 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:09.078867 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:09.217457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:09.226316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-af8d57ed-bfa9-4072-8bd6-e8b1d7a04c0e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.161068 Aug 01 15:32:09.227089 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 656/1305] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:09 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:10.250212 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:10.251108 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:10.257560 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:10.258018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:10.258869 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:10.259308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:10.413165 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:10.421442 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-48140ca2-7b7f-4dbb-98cc-f8370c739ff2 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.177181 Aug 01 15:32:10.422103 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 650/1306] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:10 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:11.443203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:11.443779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:11.450956 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:11.451403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:11.452203 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:11.452638 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:11.583028 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:11.590537 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-132447e5-c5c8-4f70-81a1-cec263360747 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.151316 Aug 01 15:32:11.591123 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 657/1307] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:11 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:12.612980 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:12.613595 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:12.620330 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:12.620784 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:12.621552 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:12.622020 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:12.761475 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:12.769202 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5acb7495-dfd3-4d9c-bdfa-245b21bbf81b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.160632 Aug 01 15:32:12.769762 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 651/1308] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:12 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:13.791133 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:13.791765 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:13.799005 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:13.799385 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:13.800142 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:13.800570 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:13.935232 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:13.942894 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4b5fbe19-4cf0-423d-b4f3-f0f3eef2a054 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.155580 Aug 01 15:32:13.943457 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 658/1309] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:13 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:14.964891 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:14.965503 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:14.972557 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:14.972997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:14.973752 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:14.974176 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:15.103180 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:15.110724 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-559e1d5b-af2a-4a6a-8b74-6f4c4cc92e88 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.149660 Aug 01 15:32:15.111284 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 652/1310] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:14 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:16.132486 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:16.133095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:16.140193 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:16.140706 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:16.141489 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:16.141926 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:16.277980 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:16.285912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-53208100-ed41-4a16-a6dd-b1396475cde9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.157482 Aug 01 15:32:16.286479 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 659/1311] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:16 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:17.309092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:17.309708 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:17.316827 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:17.317267 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:17.318037 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:17.318466 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:17.452080 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:17.459763 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0fca1d5d-ece6-4b1f-91aa-b8ba4e8af863 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.155208 Aug 01 15:32:17.460332 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 653/1312] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:17 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:18.482115 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:18.482950 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:18.491095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:18.491549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:18.492373 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:18.492810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:18.651533 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:18.660386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-86fb6728-95a2-4699-a40f-57ef60267dcb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.182707 Aug 01 15:32:18.660968 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 660/1313] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:18 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:19.687081 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:19.687854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:19.695876 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:19.696416 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:19.697299 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:19.697817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:19.884066 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:19.891918 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e0e9808e-f961-4007-ae3c-310849970ea4 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.208918 Aug 01 15:32:19.892494 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 654/1314] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:19 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:20.914189 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:20.915503 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:20.922768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:20.923220 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:20.924097 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:20.924417 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:21.075860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:21.083860 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5cf40840-c988-469f-9396-217e85dc7e8d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.173474 Aug 01 15:32:21.084428 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 661/1315] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:20 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:22.106817 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:22.107421 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:22.114654 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:22.115126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:22.115944 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:22.116357 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:22.270554 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:22.278605 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-41b67e07-aa85-4fc1-ba20-f7f073f22dbf tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.176355 Aug 01 15:32:22.279210 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 655/1316] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:22 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:23.300693 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:23.301371 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:23.308419 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:23.308866 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:23.309641 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:23.310080 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:23.447755 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:23.460589 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-f4556b01-cdbd-438d-9597-8ceef593624b tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.163462 Aug 01 15:32:23.461528 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 662/1317] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:23 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:24.483729 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:24.484341 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:24.491374 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:24.491824 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:24.492601 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:24.493034 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:24.633563 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:24.641963 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-47334066-1321-45bb-8cee-f6b250c603f0 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1572 microversion: 2.1 time: 0.162982 Aug 01 15:32:24.642693 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 656/1318] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:24 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:24.665167 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:24.665787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:24.673095 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:24.673536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:24.674307 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:24.674787 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:24.720255 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117887) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:32:24.796576 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-faf48d01-ae9c-4914-9364-d2c6ef1f9aa6 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "POST /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e/action" status: 202 len: 0 microversion: 2.1 time: 0.137206 Aug 01 15:32:24.797190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 663/1319] 10.222.0.100 () {60 vars in 1283 bytes} [Mon Aug 1 15:32:24 2022] POST /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:32:24.807238 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:24.808040 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:24.816178 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:24.816895 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:24.817835 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:24.818440 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:24.969016 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:24.977009 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-596d4f08-7fd0-43a5-a125-ea267263fecd tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1580 microversion: 2.1 time: 0.175552 Aug 01 15:32:24.977597 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 657/1320] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:24 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1580 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:26.000768 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:26.001549 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:26.007738 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:26.008190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:26.008967 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:26.009403 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:26.165670 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:26.173584 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-815af6dd-958c-4575-8b4d-e3f8c99bf409 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1580 microversion: 2.1 time: 0.177978 Aug 01 15:32:26.174163 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 664/1321] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:25 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1580 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:27.195678 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:27.196468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:27.206767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:27.206767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:27.206767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:27.206767 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:27.345923 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:27.354427 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7c1825e0-aec8-4efc-b94f-ac24567e21aa tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1580 microversion: 2.1 time: 0.162731 Aug 01 15:32:27.355041 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 658/1322] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:27 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:27.727129 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-2b3aefa9-423e-4c8b-bee3-b5f65d7513f1 req-24e4f49c-8a5f-4feb-b5e7-05f3d95dece6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "name": "network-vif-unplugged", "status": "completed", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:27.737309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-2b3aefa9-423e-4c8b-bee3-b5f65d7513f1 req-24e4f49c-8a5f-4feb-b5e7-05f3d95dece6 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:27.737677 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-2b3aefa9-423e-4c8b-bee3-b5f65d7513f1 req-24e4f49c-8a5f-4feb-b5e7-05f3d95dece6 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:27.749943 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.compute.server_external_events [req-2b3aefa9-423e-4c8b-bee3-b5f65d7513f1 req-24e4f49c-8a5f-4feb-b5e7-05f3d95dece6 service nova] Unable to find a host for instance 606055df-c608-4042-a2f4-c99ccca2367e. Dropping event network-vif-unplugged {{(pid=117887) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 15:32:27.750865 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-2b3aefa9-423e-4c8b-bee3-b5f65d7513f1 req-24e4f49c-8a5f-4feb-b5e7-05f3d95dece6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.088439 Aug 01 15:32:27.751455 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 665/1323] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 15:32:28.376391 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:28.377007 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:28.383444 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:28.383886 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:28.384643 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:28.385063 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:28.514706 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:28.523137 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-efac0704-6939-4ba9-ab47-45d196ff7d2c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1522 microversion: 2.1 time: 0.151148 Aug 01 15:32:28.523809 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 659/1324] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:28 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:32:29.545400 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:29.546025 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:29.552668 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:29.553183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:29.553966 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:29.554405 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:29.692577 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:29.702119 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-14a6626b-797c-4a39-b884-9946c6a5cd5c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1522 microversion: 2.1 time: 0.160649 Aug 01 15:32:29.702699 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 666/1325] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:29 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:30.723779 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:30.724352 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:30.731018 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:30.731468 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:30.732237 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:30.733196 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:30.867164 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:30.875172 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-550f9f56-55de-418e-8b86-be722b78005c tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1522 microversion: 2.1 time: 0.155434 Aug 01 15:32:30.875782 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 660/1326] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:30 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:31.896000 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:31.896600 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:31.903102 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:31.903543 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:31.904296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:31.904726 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:32.031766 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:32.042125 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-44485e13-758e-4c05-b9ae-7970b79b4982 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1522 microversion: 2.1 time: 0.149976 Aug 01 15:32:32.042708 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 667/1327] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:31 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:33.063882 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:33.064506 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:33.071095 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:33.071550 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:33.072321 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:33.072756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:33.214978 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:33.224122 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9089f4b9-a7c2-406c-aae1-d3267b97e342 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.164185 Aug 01 15:32:33.224703 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 661/1328] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:33 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:34.245912 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:34.246499 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:34.253938 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:34.254386 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:34.255183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:34.255618 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:34.412835 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:34.420954 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-619e32e9-232d-4efe-b7b7-29edd82bc7a9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.178463 Aug 01 15:32:34.421548 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 668/1329] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:34 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:35.442067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:35.442685 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:35.449711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:35.450151 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:35.451171 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:35.451602 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:35.593822 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:35.601787 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dcb1dcc3-387f-4dc2-bc61-92507271004f tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.163495 Aug 01 15:32:35.602363 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 662/1330] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:35 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:36.624680 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:36.625296 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:36.632087 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:36.632539 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:36.633309 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:36.633748 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:36.769858 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:36.773209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:36.781141 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-2edf1539-c90c-463c-8388-3c940e932760 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.160898 Aug 01 15:32:36.781712 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 669/1331] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:36 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:37.802441 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:37.802997 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:37.805296 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=27 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:37.810769 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:37.811756 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:37.812796 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:37.813240 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:37.816158 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=79 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:37.946316 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:37.954221 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd0a5ff9-adc1-4776-8588-1ed1cdc33c9e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.155788 Aug 01 15:32:37.954816 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 663/1332] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:37 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:38.975743 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:38.977579 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:38.978779 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:38.986970 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:38.987565 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:38.988698 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:38.989681 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:39.123936 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:39.131764 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-d0167117-aa1a-4946-b2cc-3fa0f34a74fb tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.160244 Aug 01 15:32:39.132327 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 670/1333] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:38 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:40.153994 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:40.154608 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:40.161998 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:40.162446 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:40.163320 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:40.163751 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:40.309183 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:40.317043 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-121b9b59-f4e2-4eb8-842f-463dee6fe1f3 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.166914 Aug 01 15:32:40.317831 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 664/1334] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:40 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:41.339602 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:41.340190 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:41.346942 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.347586 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.348341 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.348767 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.483644 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:41.491666 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-4e4e9133-d173-4002-b321-6dfaca28426d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.156017 Aug 01 15:32:41.492231 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 671/1335] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:41 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:42.513802 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:42.514974 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:42.521629 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:42.522104 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:42.522915 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:42.523349 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:42.657389 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:42.665008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4def99e1-ed1a-41f9-aa46-4a6f6931d14e tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.155143 Aug 01 15:32:42.665570 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 665/1336] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:42 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:43.686623 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:43.687215 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:43.694068 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:43.694509 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:43.695302 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:43.695739 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:43.828601 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:43.836587 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-a2cf0899-325e-419d-bc94-d8522e9e210d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.153891 Aug 01 15:32:43.837151 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 672/1337] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:43 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:44.860619 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:44.861346 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:44.868008 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:44.868497 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:44.869273 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:44.869713 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:45.133931 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:45.153077 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8628fe88-6dd1-4952-aca4-bf499e63c149 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.296530 Aug 01 15:32:45.153672 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 666/1338] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:44 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:45.770522 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-d98f28c8-9a57-45a2-97f3-1a3852a60c2b req-a7773cf3-f139-44cc-b527-166eb74ded2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "name": "network-vif-plugged", "status": "completed", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:45.783434 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d98f28c8-9a57-45a2-97f3-1a3852a60c2b req-a7773cf3-f139-44cc-b527-166eb74ded2e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:45.784035 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-d98f28c8-9a57-45a2-97f3-1a3852a60c2b req-a7773cf3-f139-44cc-b527-166eb74ded2e service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:45.796874 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-d98f28c8-9a57-45a2-97f3-1a3852a60c2b req-a7773cf3-f139-44cc-b527-166eb74ded2e service nova] Creating event network-vif-plugged:515ef845-da04-4f16-bcd5-2ad3a435334b for instance 606055df-c608-4042-a2f4-c99ccca2367e on hv-cinder-84327 Aug 01 15:32:45.802406 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-d98f28c8-9a57-45a2-97f3-1a3852a60c2b req-a7773cf3-f139-44cc-b527-166eb74ded2e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035999 Aug 01 15:32:45.803331 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 673/1339] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:46.177308 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:46.177929 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:46.184640 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:46.185090 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:46.185907 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:46.186338 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:46.335711 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:46.346126 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1c1829b5-e2e8-4e7e-aa5e-5ea2a92b82c5 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.172511 Aug 01 15:32:46.347451 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 667/1340] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:46 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:47.369490 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:47.370209 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:47.377037 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:47.377484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:47.378379 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:47.378846 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:47.525888 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:47.533491 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-61e2d9f2-3110-4ae9-b698-fbacc4af7654 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1578 microversion: 2.1 time: 0.168732 Aug 01 15:32:47.534159 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 674/1341] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:47 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:48.559281 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:48.560331 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:48.571241 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:48.572023 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:48.573393 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:48.574695 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:48.979211 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:48.987285 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7fe19b34-8ceb-44ef-b6b4-3017dc9a3541 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1565 microversion: 2.1 time: 0.434543 Aug 01 15:32:48.987957 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 668/1342] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:32:48 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1565 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:06.502840 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:33:06.503728 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:34:41.446855 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=11 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:41.447651 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=35 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:41.451143 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:41.451676 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:41.456313 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_api:SELECT=9 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:41.457019 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG dbcounter [-] [117887] Writing DB stats nova_cell1:SELECT=27 {{(pid=117887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:41.465444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.465444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.465444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.465444 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.494791 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Going to try to terminate instance {{(pid=117887) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:34:41.594472 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-781593e9-833e-486c-9271-4f758ef97193 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "DELETE /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 204 len: 0 microversion: 2.1 time: 0.149938 Aug 01 15:34:41.597017 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 675/1343] 10.222.0.100 () {58 vars in 1244 bytes} [Mon Aug 1 15:34:41 2022] DELETE /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:34:41.608127 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:41.608960 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:41.616083 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.616524 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.617306 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.617731 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.671853 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-dc856ca6-2c68-4329-b42c-18c9882c45a0 req-2ae2a202-594c-489c-af74-dcddf33b9aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:41.682934 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-dc856ca6-2c68-4329-b42c-18c9882c45a0 req-2ae2a202-594c-489c-af74-dcddf33b9aa1 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:41.683745 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-dc856ca6-2c68-4329-b42c-18c9882c45a0 req-2ae2a202-594c-489c-af74-dcddf33b9aa1 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:41.696778 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-dc856ca6-2c68-4329-b42c-18c9882c45a0 req-2ae2a202-594c-489c-af74-dcddf33b9aa1 service nova] Creating event network-changed:515ef845-da04-4f16-bcd5-2ad3a435334b for instance 606055df-c608-4042-a2f4-c99ccca2367e on hv-cinder-84327 Aug 01 15:34:41.703131 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-dc856ca6-2c68-4329-b42c-18c9882c45a0 req-2ae2a202-594c-489c-af74-dcddf33b9aa1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257225 Aug 01 15:34:41.704092 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 669/1344] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:34:41.778316 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.policy [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117887) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:41.786900 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-74721908-c3a1-4e57-b4b3-fc1ae3ec13b9 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.184143 Aug 01 15:34:41.787484 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 676/1345] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:34:41 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:42.807886 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:42.808585 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:42.815598 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.816042 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.816814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:42.817245 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:42.983542 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:42.992271 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-306e1c55-9817-48af-b5ed-bff3a59fff56 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1571 microversion: 2.1 time: 0.188448 Aug 01 15:34:42.992854 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 670/1346] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:34:42 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1571 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:43.978410 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [req-33edf190-4849-4f6a-8cf6-c5dd45f0eaa7 req-33b5c557-1071-4434-a117-8214158f2b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606055df-c608-4042-a2f4-c99ccca2367e", "name": "network-vif-deleted", "tag": "515ef845-da04-4f16-bcd5-2ad3a435334b"}]} {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:43.998183 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-33edf190-4849-4f6a-8cf6-c5dd45f0eaa7 req-33b5c557-1071-4434-a117-8214158f2b29 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:43.998740 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [req-33edf190-4849-4f6a-8cf6-c5dd45f0eaa7 req-33b5c557-1071-4434-a117-8214158f2b29 service nova] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.012999 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.compute.server_external_events [req-33edf190-4849-4f6a-8cf6-c5dd45f0eaa7 req-33b5c557-1071-4434-a117-8214158f2b29 service nova] Creating event network-vif-deleted:515ef845-da04-4f16-bcd5-2ad3a435334b for instance 606055df-c608-4042-a2f4-c99ccca2367e on hv-cinder-84327 Aug 01 15:34:44.018690 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [req-33edf190-4849-4f6a-8cf6-c5dd45f0eaa7 req-33b5c557-1071-4434-a117-8214158f2b29 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043848 Aug 01 15:34:44.019742 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 677/1347] 10.222.0.100 () {64 vars in 1322 bytes} [Mon Aug 1 15:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:44.022901 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:44.024059 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:44.037682 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:44.038360 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.039422 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:44.039863 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:44.112147 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250e40933543431981bcb19db78fa144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf605507bae49a0a797b96db9da31bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:44.121067 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2609cad6-36b2-409f-84c5-a8c493598496 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 200 len: 1222 microversion: 2.1 time: 0.109772 Aug 01 15:34:44.121641 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 671/1348] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:34:44 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:45.148193 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '>' {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:45.148897 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.compute.api [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] [instance: 606055df-c608-4042-a2f4-c99ccca2367e] Fetching instance by UUID {{(pid=117887) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:45.155320 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.155794 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.156581 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:45.157052 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG oslo_concurrency.lockutils [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Lock "8095a37a-5f92-4ee4-807c-ac452f10613a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:45.170582 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.wsgi [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] HTTP exception thrown: Instance 606055df-c608-4042-a2f4-c99ccca2367e could not be found. Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Request method failure captured: Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: request: GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e HTTP/1.1 Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept: application/json Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Accept-Encoding: identity Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Connection: close Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Length: 0 Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Content-Type: application/json Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Host: 10.222.0.100 Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Openstack-System-Scope: None Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: User-Agent: python-urllib3/1.26.10 Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Auth-Token: gAAAAABi5_E6fgN26oU7WRAVHDuXkzSSMuw3IYbm9hb2k_oDagIUanpH07E6umrLaMC7iMMLpoOnuB5E-tMiHDRq4o3-qb21jKqHvZ2SQ0EvyhVK_LcQ78QseaAKjNakO73IF9JFNMFBfX9sxcgu3rMIgD6jINo7_GMPis-H2QkUBwgq_e9Wyq0 Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Id: None Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Domain-Name: None Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Identity-Status: Confirmed Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Is-Admin-Project: True Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Id: default Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Domain-Name: Default Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Id: 7cf605507bae49a0a797b96db9da31bd Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Project-Name: tempest-TestShelveInstance-1132294569 Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Role: member,reader Aug 01 15:34:45.172264 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Roles: member,reader Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_7cf605507bae49a0a797b96db9da31bd", "adminURL": "http://10.222.0.100:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/7cf605507bae49a0a797b96db9da31bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/7cf605507bae49a0a797b96db9da31bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/7cf605507bae49a0a797b96db9da31bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}] Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant: tempest-TestShelveInstance-1132294569 Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Id: 7cf605507bae49a0a797b96db9da31bd Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-Tenant-Name: tempest-TestShelveInstance-1132294569 Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User: tempest-TestShelveInstance-1132294569-project Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Id: default Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Domain-Name: Default Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Id: 250e40933543431981bcb19db78fa144 Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: X-User-Name: tempest-TestShelveInstance-1132294569-project Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: method: > Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: exception: Instance 606055df-c608-4042-a2f4-c99ccca2367e could not be found. Aug 01 15:34:45.175196 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: action_args: {'id': '606055df-c608-4042-a2f4-c99ccca2367e'} Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: {{(pid=117887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606055df-c608-4042-a2f4-c99ccca2367e could not be found. Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:34:45.177079 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606055df-c608-4042-a2f4-c99ccca2367e could not be found. Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606055df-c608-4042-a2f4-c99ccca2367e could not be found. Aug 01 15:34:45.179919 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: ERROR nova.api.openstack.wsgi Aug 01 15:34:45.182810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: DEBUG nova.api.openstack.wsgi [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Returning 404 to user: Instance 606055df-c608-4042-a2f4-c99ccca2367e could not be found. {{(pid=117887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:34:45.182810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO nova.api.openstack.requestlog [None req-5067c3fc-eb8b-467f-84dd-620849b7463d tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e" status: 404 len: 111 microversion: 2.1 time: 0.030289 Aug 01 15:34:45.182810 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: [pid: 117887|app: 0|req: 678/1349] 10.222.0.100 () {58 vars in 1241 bytes} [Mon Aug 1 15:34:45 2022] GET /compute/v2.1/servers/606055df-c608-4042-a2f4-c99ccca2367e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:34:45.346783 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1f118455-c660-47f2-8781-952e43b4b325 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] Calling method '.version_select at 0x7efd1d429dc0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:45.373223 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1f118455-c660-47f2-8781-952e43b4b325 tempest-TestShelveInstance-1132294569 tempest-TestShelveInstance-1132294569-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1707530113" status: 202 len: 0 microversion: 2.1 time: 0.030295 Aug 01 15:34:45.373846 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 672/1350] 10.222.0.100 () {58 vars in 1259 bytes} [Mon Aug 1 15:34:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1707530113 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:34:45.667336 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:34:45.667622 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:36:56.958565 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:36:56.959590 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Mon Aug 1 15:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:38:05.677355 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:38:05.677964 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:38:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:38:06.688485 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:38:06.689110 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Mon Aug 1 15:38:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:39:46.514879 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:39:46.515814 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:39:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:40:14.395042 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:40:14.395869 dv-cinder-843277-7-iscsi devstack@n-api.service[117886]: Mon Aug 1 15:40:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:40:16.973536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:40:16.974156 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Mon Aug 1 15:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:40:20.091536 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:40:20.092368 dv-cinder-843277-7-iscsi devstack@n-api.service[117887]: Mon Aug 1 15:40:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!